WO2022062456A1 - Method and apparatus for controlling output of detection result of fetal ultrasound image, and system - Google Patents

Method and apparatus for controlling output of detection result of fetal ultrasound image, and system Download PDF

Info

Publication number
WO2022062456A1
WO2022062456A1 PCT/CN2021/096816 CN2021096816W WO2022062456A1 WO 2022062456 A1 WO2022062456 A1 WO 2022062456A1 CN 2021096816 W CN2021096816 W CN 2021096816W WO 2022062456 A1 WO2022062456 A1 WO 2022062456A1
Authority
WO
WIPO (PCT)
Prior art keywords
feature
fetal ultrasound
ultrasound image
features
detection
Prior art date
Application number
PCT/CN2021/096816
Other languages
French (fr)
Chinese (zh)
Inventor
谢红宁
汪南
冼建波
梁喆
吴杰林
吴婉萍
许生鸿
Original Assignee
广州爱孕记信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州爱孕记信息科技有限公司 filed Critical 广州爱孕记信息科技有限公司
Publication of WO2022062456A1 publication Critical patent/WO2022062456A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0866Detecting organic movements or changes, e.g. tumours, cysts, swellings involving foetal diagnosis; pre-natal or peri-natal diagnosis of the baby
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10132Ultrasound image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30044Fetus; Embryo

Definitions

  • the present invention relates to the technical field of image processing, and in particular, to a method, device and system for outputting a detection result of a fetal ultrasound image.
  • the acquisition method of fetal growth and development is as follows: using the principle of ultrasonic collection of echoes, displaying fetal tomographic images on the screen, and obtaining fetal dynamic images, then the staff with relevant experience will analyze the detection of fetal ultrasound images based on their own experience. As a result, the growth and development of the fetus can be determined. However, it has been found in practice that, due to limited experience and/or fatigue of the staff, this can easily lead to the failure to obtain high-accuracy fetal ultrasound image detection results, so that the fetal growth and development cannot be accurately determined.
  • the technical problem to be solved by the present invention is to provide an output control method, device and system of fetal ultrasound image detection results, which can obtain accurate fetal ultrasound image detection results to accurately determine fetal growth and development.
  • the first aspect of the present invention discloses a method for outputting a detection result of a fetal ultrasound image.
  • the method is applied to an intelligent detection system, and the method includes:
  • the intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image;
  • the intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the detection result
  • the detection result includes detection results of multiple features of the fetal ultrasound image, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of a feature to be checked, a checked and normal feature, a checked and suspected feature, and a checked and abnormal feature, the checked and suspected feature is a feature of a detected and uncertain category, the checked and Anomalous features are features that have been detected and that have anomalous structural features.
  • the method further includes:
  • the intelligent detection system judges whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image;
  • the intelligent detection system controls the output terminal to output a schematic diagram of a section corresponding to each of the key detection features, and each The schematic diagram of the section corresponding to the key detection feature includes the output identification of each structural feature in the standard section corresponding to the key detection feature;
  • the intelligent detection system determines the detection situation of the structural feature corresponding to the output mark according to the change of each of the output marks included in the schematic section diagram corresponding to each of the key detection features;
  • each of the output signs included in the schematic section diagram corresponding to the key detection feature when the change of each of the output signs included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output sign changes from the first state to the second state, each The detection situation of the structural feature corresponding to each of the output identifiers is used to indicate that the structural feature is detected in the corresponding standard section.
  • the output interface of the output terminal includes a first area and a second area, the first area is used for outputting the detection result, and the second area is used for outputting the detection result.
  • the area is used to output a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image.
  • the list is used to store a plurality of checked features of the fetal ultrasound image, and the categories of all the features to be checked included in the feature list to be checked include the categories of all the checked features included in the checked feature list , the categories of the multiple features included in the fetal ultrasound image include all categories of the features to be checked included in the feature list to be checked.
  • all the features included in the fetal ultrasound image include multiple structural features of the fetal ultrasound image, and the detection result of each of the features further includes The feature parameter of the feature, the feature parameter of each feature includes the category information of the feature;
  • the method further includes:
  • the intelligent detection system determines the part feature of the fetal ultrasound image of the frame where each of the structural features included in the fetal ultrasound image is located, and determines the feature parameter of each of the part features, and the feature parameters of each of the part features include: Category information of the feature of the part;
  • the intelligent detection system determines the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the standard section of the feature. test results.
  • the method further includes:
  • the intelligent detection system determines whether a playback request triggered by a fetal ultrasound image corresponding to a certain target feature category is detected, and the playback request is used to request playback of the fetal ultrasound image corresponding to the target feature category, and the target feature category
  • the corresponding fetal ultrasound images include the optimal frame fetal ultrasound images corresponding to the target feature category, fetal ultrasound images of all standard slices corresponding to the target feature category, and fetal ultrasound images of all chapters corresponding to the target feature category.
  • the fetal ultrasound image includes a fetal ultrasound image corresponding to the target feature category, the target feature category includes a target structural feature category and/or a target standard slice category, and each of the sections included in each of the The same categories of standard slices of fetal ultrasound images;
  • the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, and controls the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
  • the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, including:
  • the intelligent detection system determines that each of the standard slices corresponding to the target feature category The slice score of the standard slice;
  • the intelligent detection system determines the frame fetus corresponding to the standard slice corresponding to the highest slice score from all the standard slices according to the slice score of each of the standard slices corresponding to the target feature category.
  • the ultrasound image is taken as the optimal frame fetal ultrasound image corresponding to the target feature category.
  • the intelligent detection system according to the slice score of each of the standard slices in all the standard slices corresponding to the target feature category, from all the standard slices before determining the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score among the standard slices as the optimal frame fetal ultrasound image corresponding to the target feature category, the method further includes:
  • the intelligent detection system determines whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include at least two matching standard slices category or at least two matching chapter categories;
  • the intelligent detection system determines the slice score of each of the standard slices in all standard slices corresponding to each of the matching feature categories corresponding to the target feature category, and determines the slice score of each of the standard slices according to each of the standard slices.
  • the slice score of each of the standard slices corresponding to the matching feature categories is selected, the frame fetal ultrasound images corresponding to the highest slice score are selected from all the standard slices, and the frame fetal ultrasound images corresponding to all the matching feature categories are determined as The optimal frame fetal ultrasound image corresponding to the target feature category, and the number of the optimal frame fetal ultrasound image corresponding to the target feature category is greater than 1.
  • the method further includes:
  • the intelligent detection system determines whether there are any abnormal features in all the features included in the fetal ultrasound image, and when the determination result is yes, selects all the abnormal features from all the features included in the fetal ultrasound image;
  • the intelligent detection system sorts all the abnormal features according to the determined sorting method, obtains all the sorted abnormal features, and controls the output terminal to output all the sorted abnormal features.
  • a second aspect of the present invention discloses an output control device for detection results of fetal ultrasound images, the device is applied in an intelligent detection system, and the device includes:
  • the analysis module is used for inputting the received fetal ultrasound image into the determined image analysis model for analysis
  • an acquisition module configured to acquire the analysis result output by the image analysis model as the detection result of the fetal ultrasound image
  • control module configured to control the output terminal corresponding to the intelligent detection system to output the detection result
  • the detection result includes detection results of multiple features of the fetal ultrasound image, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of a feature to be checked, a checked and normal feature, a checked and suspected feature, and a checked and abnormal feature, the checked and suspected feature is a feature of a detected and uncertain category, the checked and Anomalous features are features that have been detected and that have anomalous structural features.
  • the device further includes:
  • a first judgment module configured to judge whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image
  • the control module is further configured to control the output terminal to output and each of the key points when the first determination module determines that all the features included in the fetal ultrasound image have at least one of the key detection features.
  • a schematic diagram of a section corresponding to the detection feature, and the schematic diagram of a section corresponding to each of the key detection features includes the output identifier of each structural feature in the standard section corresponding to the key detection feature;
  • a first determination module configured to determine the detection situation of the structural feature corresponding to the output marker according to the change situation of each of the output markers included in the schematic section diagram corresponding to each of the key detection features
  • each of the output signs included in the schematic section diagram corresponding to the key detection feature when the change of each of the output signs included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output sign changes from the first state to the second state, each The detection situation of the structural feature corresponding to each of the output identifiers is used to indicate that the structural feature is detected in the corresponding standard section.
  • the output interface of the output terminal includes a first area and a second area, the first area is used for outputting the detection result, and the second area is used for outputting the detection result.
  • the area is used to output a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image.
  • the list is used to store a plurality of checked features of the fetal ultrasound image, and the categories of all the features to be checked included in the feature list to be checked include the categories of all the checked features included in the checked feature list , the categories of the multiple features included in the fetal ultrasound image include all categories of the features to be checked included in the feature list to be checked.
  • all the features included in the fetal ultrasound image include multiple structural features of the fetal ultrasound image, and the detection result of each of the features further includes The feature parameter of the feature, the feature parameter of each feature includes the category information of the feature;
  • the device also includes:
  • the acquisition module is further configured to, after acquiring the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine the fetal ultrasound image of the frame where each of the structural features included in the fetal ultrasound image is located. part features;
  • a second determination module configured to determine a feature parameter of each of the part features, and the feature parameters of each of the part features include category information of the part feature;
  • the second determination module is further configured to determine the standard section of each of the features according to the category information of each of the features and the category information of the part feature corresponding to the feature, and the detection result of each of the features also includes: The detection result of the standard slice of this feature.
  • the device further includes:
  • the second judgment module is configured to judge whether a fetal ultrasound image trigger corresponding to a certain target feature category is detected after the acquisition module obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image
  • the playback request is used to request playback of the fetal ultrasound image corresponding to the target feature category
  • the fetal ultrasound image corresponding to the target feature category includes the optimal frame fetal ultrasound image corresponding to the target feature category, all at least one of fetal ultrasound images of all standard slices corresponding to the target feature category and fetal ultrasound images of all chapters corresponding to the target feature category, and the fetal ultrasound image includes fetal ultrasound images corresponding to the target feature category
  • the target feature categories include target structural feature categories and/or target standard slice categories, and each of the chapters includes the same category of standard slices of each of the fetal ultrasound images;
  • a third determination module configured to determine the fetal ultrasound image corresponding to the target feature category according to the playback request when the second determination module determines that the result is yes;
  • the control module is further configured to control the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
  • the third determining module includes:
  • a determination submodule configured to determine each of all the standard slices corresponding to the target feature category when the fetal ultrasound image corresponding to the target feature category is the optimal frame fetal ultrasound image corresponding to the target feature category.
  • the determining sub-module is further configured to determine, from among all the standard sectional planes, the sectional plane score corresponding to the standard tangential plane with the highest sectional plane score according to the sectional plane score of each of the standard tangential planes corresponding to the target feature category.
  • the corresponding frame of fetal ultrasound image is used as the optimal frame of fetal ultrasound image corresponding to the target feature category.
  • the third determining module further includes:
  • the judging sub-module is used to determine, in the determining sub-module, the section score corresponding to the highest section score from all the standard sections according to the section score of each of the standard sections corresponding to the target feature category.
  • Two matching feature categories at least two of the matching feature categories include at least two matching standard section categories or at least two matching chapter categories; when the judgment result is no, trigger the determining sub-module to execute the The slice score of each of the standard slices in all the standard slices corresponding to the target feature category, and the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score is determined from all the standard slices as the target feature The operation of the optimal frame fetal ultrasound image corresponding to the category;
  • the determining sub-module is further configured to determine, when the determination result of the determining sub-module is yes, determine a section of each of the standard sections in all standard sections corresponding to each of the matching feature categories corresponding to the target feature category score;
  • the determining submodule is further configured to determine all frames of fetal ultrasound images corresponding to the matching feature categories, as the optimal frame fetal ultrasound images corresponding to the target feature categories, and the optimal frame fetal ultrasound images corresponding to the target feature categories.
  • the number is greater than 1.
  • the device further includes:
  • a third judgment module configured to judge whether there is any abnormality in all the features included in the fetal ultrasound image after the acquisition module obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image feature;
  • a screening module configured to screen all the abnormal features from all the features included in the fetal ultrasound image when the third judgment module determines that the result is yes;
  • a sorting module configured to sort all the abnormal features according to the determined sorting method, and obtain all the sorted abnormal features
  • the control module is configured to control the output terminal to output all the sorted abnormal features.
  • a third aspect of the present invention discloses another device for outputting the detection results of fetal ultrasound images.
  • the device is applied in an intelligent detection system, and the device includes:
  • a processor coupled to the memory
  • the processor invokes the executable program code stored in the memory to execute the output control method for the detection result of the fetal ultrasound image disclosed in the first aspect of the present invention.
  • a fourth aspect of the present invention discloses a computer storage medium, where the computer storage medium stores computer instructions, and when the computer instructions are invoked, is used to execute the output control of the detection result of the fetal ultrasound image disclosed in the first aspect of the present invention method.
  • a fifth aspect of the present invention discloses an intelligent detection system for implementing the output control method of the detection result of the fetal ultrasound image disclosed in the first aspect of the present invention.
  • the intelligent detection system analyzes the received fetal ultrasound image input into the determined image analysis model, and obtains the analysis result output by the image analysis model, as the detection result of the fetal ultrasound image, and the control and intelligence
  • the output terminal corresponding to the detection system outputs the detection result, wherein the detection result includes the detection result of multiple features of the fetal ultrasound image, the detection result of each feature includes the detection mark of the feature, and the detection mark corresponding to each feature is used to indicate the
  • the feature is one of the feature to be detected, the detected and normal feature, the detected and suspected feature, and the detected and abnormal feature.
  • the detected and suspected feature is the feature of the detected and uncertain category, and the detected and abnormal feature are features that have been detected and that have abnormal structural features.
  • the implementation of the present invention can quickly obtain accurate detection results of each feature (for example: structural features, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image, such as: abnormal, normal, suspected, detected, Undetected, it is beneficial to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed detection of features, so as to improve the possibility of successfully detecting the required detection features, thereby It is further beneficial to realize the accurate determination of the growth and development of the fetus.
  • each feature for example: structural features, section
  • FIG. 1 is a schematic flowchart of a method for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of another method for controlling the output of a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a device for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of another device for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention
  • FIG. 5 is a schematic structural diagram of another device for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of an intelligent detection system disclosed in an embodiment of the present invention.
  • the invention discloses an output control method, device and system for the detection results of fetal ultrasound images, which can quickly acquire accurate fetal ultrasound images by automatically analyzing each feature of the fetal ultrasound images (for example, structural features, Section) detection results, such as: abnormal, normal, suspected, checked, unchecked, which is conducive to accurately determining the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the number of missed features. This occurs to increase the likelihood of successful detection of the desired detection feature, thereby further facilitating accurate determination of fetal growth and development. Each of them will be described in detail below.
  • fetal ultrasound images for example, structural features, Section
  • FIG. 1 is a schematic flowchart of a method for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention.
  • the output control method of the detection result of the fetal ultrasound image described in FIG. 1 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server may include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited).
  • the output control method of the detection result of the fetal ultrasound image may include the following operations:
  • the intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image.
  • the fetal ultrasound image may be an image sent from a physical terminal device and/or a virtual terminal device that establishes a communication connection with the intelligent detection system.
  • the physical terminal device may include an ultrasonic image acquisition device, and other terminal devices having a communication connection with the ultrasonic image acquisition device, such as a computer.
  • the virtual terminal device may be a network disk and/or a cloud service terminal device, or the like.
  • the physical terminal device may also include a pluggable storage device, such as a USB flash drive.
  • the fetal ultrasound image may be a real-time image or a non-real-time image. When the fetal ultrasound image is a real-time image, the physical terminal device preferably is an ultrasound image acquisition device.
  • the detection result of the fetal ultrasound image includes detection results of multiple features of the fetal ultrasound image.
  • the detection result of the fetal ultrasound image may be a real-time analysis result of the fetal ultrasound image, or may be an analysis result output after the analysis of the fetal ultrasound image is completed.
  • the multiple features of the fetal ultrasound image include multiple structural features and/or multiple standard slices of the fetal ultrasound image.
  • the multiple features of the fetal ultrasound image may also include multiple location features. In this way, by outputting the detection results of structural features, slices and part features, more accurate ultrasound image detection results can be obtained, so as to more accurately know the growth and development of the fetus.
  • the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is a feature to be detected, a detected and normal feature, a detected and suspected feature One of the signatures and detected and abnormal signatures.
  • the detected and suspected features are features that have been detected and are of uncertain category
  • the detected and abnormal features are features that have been detected and have abnormal structural features.
  • a detected and abnormal feature is a feature that has been detected and has an abnormality.
  • the structural feature of A is the structural feature of the midline sac, and the structural feature of the midline sac is not accompanied by other structural features (for example, the structural feature of the thalamus, etc.), the structural feature of A is a suspected midline sac structural feature.
  • the detected and suspected features are features that include key structural features that match the feature and do not include other structural features
  • the detected and abnormal features are features that have been Features that are detected and present with abnormal structural features. For example: if the B standard view includes the structural features of the gastric bleb and the umbilical vein, the B standard view is the standard view of the suspected abdominal circumference; if the B standard view includes the structural features of the gastric bleb and the umbilical vein, it also includes the liver and descending aorta.
  • the B standard section is the normal abdominal circumference standard section; if the B standard section includes the structural features of abnormal gastric vesicles, the B standard section is the abnormal abdominal circumference standard section. Further optionally, different detection results of the same feature correspond to different detection identifiers.
  • the detection mark may include at least one of a graphic mark, a text mark, and a pattern mark.
  • the detection mark of the C structure feature is a green box
  • the detection mark of the C structure feature is gray Box
  • the detection result of the C structure feature is a suspected gastric vesicle structure feature
  • the detection mark of the C structure feature is a yellow box
  • the detection mark of the C structure feature It is a red box, and the box is used to frame the C structure feature.
  • the image analysis model may include at least one of a determined target analysis model, an instance segmentation model, and a semantic segmentation model that can analyze fetal ultrasound images, which is not limited in this embodiment of the present invention.
  • the intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the above detection result.
  • the output terminal corresponding to the intelligent detection system includes an output terminal integrated with the intelligent detection system and/or an output terminal independent of the intelligent detection system that has a communication connection with the intelligent detection system.
  • the output terminal includes a display terminal and/or a voice terminal, preferably a display terminal with a voice function.
  • the output interface of the output terminal includes a first area and a second area, the first area is used for outputting the above-mentioned detection result, and the second area is used for outputting a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image
  • the feature list to be checked is used to store a plurality of features to be checked of the determined fetal ultrasound image
  • the checked feature list is used to store a plurality of checked features of the fetal ultrasound image
  • the categories of the checked features include all the checked feature categories included in the checked feature list, and the multiple feature categories included in the fetal ultrasound image include all the unchecked feature categories included in the unchecked feature list.
  • the certain to-be-checked feature category can be cleared from the to-be-checked feature list.
  • the above detection result also includes a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image.
  • the output interface of the output terminal is provided with a side navigation bar
  • the side navigation bar includes a list of features to be detected and/or a list of features that have been checked
  • the side navigation bar also includes the retention of checked features
  • the retention of the checked feature is used to indicate that when the checked feature needs to be output, the output terminal is controlled to output the checked feature, and when the checked feature does not need to be output, the checked feature is hidden.
  • different detection items correspond to different side navigation bars, wherein the detection items include at least one of middle-late pregnancy test, early pregnancy test and gynecological test. When a test item needs to be detected, change to The corresponding side navigation bar.
  • the output control method of the detection result of the fetal ultrasound image may further include the following operations:
  • the intelligent detection system judges whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image;
  • the intelligent detection system controls the output terminal to output a schematic diagram of a section corresponding to each key detection feature, and the schematic section diagram corresponding to each key detection feature includes the key detection feature The output identification of each structural feature in the corresponding standard section;
  • the intelligent detection system determines the detection situation of the structural feature corresponding to the output mark according to the change of each output mark included in the schematic section diagram corresponding to each key detection feature;
  • the structure corresponding to each output flag is used to indicate that the structural feature is detected in the corresponding standard section.
  • the target information of each feature included in the fetal ultrasound image includes at least one of the category of the feature, the position of the fetus corresponding to the feature in the fetal ultrasound image, and the complexity of the feature.
  • the intelligent detection system determines whether there is a determined key detection feature in all the features, specifically: when it is determined that the category of at least one feature of all the features included in the fetal ultrasound image is the determined category of the key detection feature, and/or, When it is determined that the position in the fetal ultrasound image of at least one of all the features included in the fetal ultrasound image is the determined key position (for example, the heart), and/or, when it is determined that at least one of all the features included in the fetal ultrasound image is located When the complexity level of a feature is greater than or equal to the determined complexity level threshold, it is determined that all features included in the fetal ultrasound image have at least one key detection feature.
  • the key detection features include features whose importance level is greater than or equal to the determined importance level (for example, level 3, the higher the level, the more important) and/or the number of structural features contained in the standard section. Features greater than or equal to the number of structural features identified (for example: 5).
  • the key detection features may include key structural features and/or key standard slices. Further, when the output flag changes from the first state to the second state, the second state can be maintained, so that it can be clearly distinguished whether the structural feature corresponding to the output flag is detected, thereby improving the accuracy of the detection of key structural features. sex, thereby further improving the accuracy of determining fetal growth and development.
  • the intelligent detection system when it is determined that all the features included in the fetal ultrasound image do not have key detection features, the intelligent detection system directly ends this process.
  • this optional embodiment determines whether there is a key detection feature in all the features included in the fetal ultrasound image, and if so, outputs a schematic diagram of the section corresponding to the key detection feature, which is conducive to clearly determining that all structural features included in the corresponding standard section are detected. and reduce the occurrence of the situation where it is impossible to clearly confirm whether the structural features required to be detected for the standard section have been detected due to too many structural features included in the section, and to facilitate the relevant personnel to know the feature detection of important detection features. It is beneficial to improve the accuracy of determining the growth and development of the fetus.
  • all the features included in the above-mentioned fetal ultrasound image include multiple structural features of the fetal ultrasound image, the detection result of each feature further includes a feature parameter of the feature, and the feature parameter of each feature includes the Class information for the feature.
  • the output control method of the detection result of the fetal ultrasound image may further include the following operations:
  • the intelligent detection system determines the part feature of the fetal ultrasound image in the frame where each structural feature included in the fetal ultrasound image is located, and determines the feature parameter of each part feature, and the feature parameter of each part feature includes the category information of the part feature;
  • the intelligent detection system determines the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the detection result of the standard section of the feature.
  • this optional embodiment can improve the accuracy and reliability of determining the standard section of the fetus by determining the standard section of the structural feature according to the category information of the structural feature and the category information of the part feature of the fetal ultrasound image in the frame, thereby improving the accuracy and reliability of the determination of the standard section of the fetus. Further improve the accuracy and reliability of the detection results of fetal ultrasound images.
  • the output control method for the detection result of the fetal ultrasound image may further include the following operations:
  • the intelligent detection system judges whether there are abnormal features in all the features included in the fetal ultrasound image, and when the judgment result is yes, screen all the abnormal features from all the features included in the fetal ultrasound image;
  • the intelligent detection system sorts all abnormal features according to the determined sorting method, obtains all sorted abnormal features, and controls the output terminal to output all sorted abnormal features.
  • the abnormal features may include abnormal structural features and/or abnormal standard slices.
  • the determined sorting method includes at least one of feature importance, feature appearance duration, and feature appearance times, wherein, the higher the feature importance of a feature, the higher the feature importance of the fetal ultrasound image.
  • the intelligent detection system determines that there are abnormal features in all the features included in the fetal ultrasound image, and the fetal ultrasound image has abnormal features.
  • Abnormal features of an image include features that do not match their normal features.
  • the intelligent detection system determines whether there are abnormal features in all the features included in the fetal ultrasound image, which may include:
  • the intelligent detection system acquires the information of each structural feature of each standard slice included in the fetal ultrasound image, and the information of each structural feature is used to determine the standard slice where the structural feature is located Whether it is an abnormal standard section;
  • the intelligent detection system judges whether each structural feature matches the standard section where it is located;
  • the intelligent detection system determines that there are abnormal standard sections whose structural features are abnormal structural features in all standard sections, and the abnormal standard section is a non-matching structure Abnormal features are present in the standard view on which the feature is located, that is, all features included in the fetal ultrasound image.
  • judging whether each structural feature matches the standard section where it is located may include:
  • each structural feature of each standard section determines the representation type corresponding to each structural feature, the representation type includes numerical representation type and/or feature morphological representation type, and the information of each structural feature includes the feature of the structural feature category;
  • the representation type of the structural feature is a numerical representation type, obtain the target geometric parameter value corresponding to the structural feature, and judge whether the target geometric parameter value corresponding to the structural feature is within the predetermined normal parameter value range, and when the judgment result is no When , it is determined that the structural feature does not match the standard section where it is located;
  • the representation type of the structural feature is the feature morphological representation type
  • the detection area of each part feature can be selected by a detection frame, such as a polygon frame or an oval frame.
  • the target geometric parameter value corresponding to each structural feature includes the transverse diameter corresponding to the structural feature and/or the perimeter corresponding to the structural feature, so that the more content the geometric parameter value includes, the more beneficial it is Improve the judgment accuracy that the structural features match the standard section where they are located.
  • different structural features have corresponding normal parameter value ranges, wherein the normal parameter value ranges corresponding to different structural features may be the same or different.
  • different geometric parameter values of the same structural feature correspond to different normal parameter value ranges.
  • the geometric parameter values corresponding to each structural feature may include proportional dimensions and/or actual dimensions.
  • the actual size corresponding to the structural feature is further obtained, and it is judged whether the actual size is within the predetermined normal size range.
  • the judgment result is no, it is determined that the structural feature does not match the standard section where it is located.
  • the accuracy of determining whether the structural feature matches the standard section where it is located can be improved, thereby reducing the error correction of the section score of the abnormal standard section. If the situation occurs, improve the accuracy and reliability of the correction of the section score of the abnormal standard section.
  • the structural feature when it is judged that the structural feature is located in the detection area of the part feature corresponding to the structural feature, it is judged whether the structural feature exists in all multiple frames of fetal ultrasound images, and when the judgment result is yes, the structural feature is determined
  • the feature does not match the standard slice it is in.
  • the multiple frames of fetal ultrasound images may be fetal ultrasound images that appear continuously or intermittently after the first frame of fetal ultrasound images with structural features as the first frame of fetal ultrasound images. In this way, when it is judged that the structural feature is in the detection area of the corresponding part feature, it is further judged whether there are multiple frames of fetal ultrasound images with the structural feature.
  • the accuracy of determining whether the feature matches the standard slice where it is located can reduce the occurrence of incorrect correction of the slice score of the abnormal standard slice, and improve the accuracy and reliability of the correction of the slice score of the abnormal standard slice.
  • the fetal ultrasound image when judging that the fetal ultrasound image has structural features, it can determine whether the structural features match the standard section where the structural features are located by using the obtained geometric parameter values of the structural features, or whether the structural features are located in the corresponding In the detection area of the part feature, to realize the judgment of whether the structural feature matches the standard section where it is located, it can improve the possibility, accuracy and efficiency of determining whether the structural feature matches the standard section where it is located.
  • all sorted abnormal features may be located in the aforementioned unchecked feature list, or may be located in the aforementioned checked feature list, and a new abnormal feature list may be created for all abnormal features, that is, the sorted feature list.
  • Anomalous features are in the list of unusual features.
  • all the sorted abnormal features can be sorted at the front position in the corresponding list. In this way, by placing the abnormal features at the front of the list, it is helpful for the relevant personnel to know the abnormal features of the fetal ultrasound images more clearly and quickly, so as to further quickly and clearly know that the abnormal growth and development of the fetus has occurred.
  • the detection result in step 102 may also include all sorted abnormal features, that is, the action of the intelligent detection system controlling the output terminal to output all sorted abnormal features may occur simultaneously with step 102 .
  • all the abnormal features in the fetal ultrasound image after detecting that all the features in the fetal ultrasound image have abnormal features, all the abnormal features are further sorted, and the sorted abnormal features are output, which is helpful for the relevant personnel to quickly know the status of the fetal ultrasound image. Abnormal characteristics of the situation, so as to further quickly and clearly know that the growth and development of the fetus is abnormal.
  • the output control method for the detection result of the fetal ultrasound image may further include the following operations:
  • the intelligent detection system judges whether all the features to be checked in the above-mentioned list of features to be checked have features that have been detected, and when the judgment result is yes, the output terminal is controlled to output prompt information to the relevant personnel.
  • the prompt information may be output only after all the features to be checked in the feature list to be checked have been detected, which is not limited in this optional embodiment.
  • the output mode of the prompt information includes a graphic display output mode and/or a voice output mode (for example, a "ding" sound, the detection of the abdominal girth section is completed, etc.), and the detection result of the above-mentioned features includes the prompt information .
  • this optional embodiment automatically outputs prompt information to the relevant personnel after the detection of the features to be inspected is completed, without the need for the relevant personnel to supervise in real time which features have been detected and which have not been detected, so that the relevant personnel can quickly, clearly and accurately know the features. completion of the detection.
  • the output control method for the detection result of the fetal ultrasound image described in FIG. 1 can quickly obtain accurate information of each feature (eg, structural feature, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image.
  • the detection results such as: abnormal, normal, suspected, checked, and unchecked, help to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed feature detection, In order to improve the probability of successful detection of the desired detection features, it is further beneficial to accurately determine the growth and development of the fetus.
  • FIG. 2 is a schematic flowchart of another method for controlling the output of detection results of fetal ultrasound images disclosed in an embodiment of the present invention.
  • the output control method of the detection result of the fetal ultrasound image described in FIG. 2 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server can include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited).
  • the output control method of the detection result of the fetal ultrasound image may include the following operations:
  • the intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image.
  • the intelligent detection system determines whether a playback request triggered by a fetal ultrasound image corresponding to a certain target feature category is detected. When the judgment result is yes, the execution of step 203 is triggered; when the judgment result is no, the current process can be ended, and the execution of step 205 can be triggered.
  • the playback request is used to request playback of a fetal ultrasound image corresponding to a target feature category
  • the fetal ultrasound image corresponding to the target feature category includes an optimal frame fetal ultrasound image corresponding to the target feature category
  • the target feature category corresponds to the fetal ultrasound image.
  • At least one of fetal ultrasound images of all standard slices of the target feature category, and fetal ultrasound images of all chapters corresponding to the target feature category, the above-mentioned fetal ultrasound images include fetal ultrasound images corresponding to the target feature category, and each fetal ultrasound image included in each chapter.
  • the categories of the standard slices of the image are the same, and the target feature category includes the target structure feature category and/or the target standard section category.
  • the number of target feature categories is greater than or equal to 1, it is possible to request playback of more than two types of fetal ultrasound images at one time, for example: the optimal frame fetal ultrasound image corresponding to the standard abdominal circumference view and the fetal ultrasound image corresponding to the standard view of the thalamus Optimal frame fetal ultrasound image.
  • the sound pickup device of the intelligent detection system collects keywords (for example: abdominal circumference) for the target feature category, it is determined that a playback request triggered by the fetal ultrasound image corresponding to the target feature category is detected; when the intelligent detection The display device of the system receives the keyword (for example: abdominal circumference) for the target feature category, and determines that a playback request triggered by the fetal ultrasound image corresponding to the target feature category is detected; when the intelligent detection system receives and establishes a connection with the intelligent detection system
  • the keyword (eg, abdominal circumference) for the target feature category sent by the communicating terminal device (eg, computer, mobile phone) determines that a playback request triggered by the fetal ultrasound image corresponding to the target feature category is detected.
  • a playback request posture (eg: gesture) of the fetal ultrasound image corresponding to a plurality of feature categories is preset.
  • the display device of the intelligent detection system receives the gesture for the target feature category, it is determined that the target feature is detected.
  • the playback request triggered by the fetal ultrasound image corresponding to the category.
  • the optimal frame fetal ultrasound images corresponding to each target feature category, the fetal ultrasound images of all standard slices corresponding to the target feature category, and the playback request gestures of the fetal ultrasound images of all chapters corresponding to the target feature category are also all displayed.
  • the optimal frame fetal ultrasound images corresponding to each target feature category, the fetal ultrasound images of all standard slices corresponding to the target feature category, and the playback request gestures of the fetal ultrasound images of all chapters corresponding to the target feature category are also all displayed. In this way, by setting different playback request gestures for images of the same structural feature category and different standard slice categories, it is possible to further improve the playback accuracy and efficiency of fetal ultrasound images corresponding to structural features and/or standard slices.
  • the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request.
  • the intelligent detection system controls the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
  • the intelligent detection system when the fetal ultrasound images corresponding to the target feature category are fetal ultrasound images of all standard slices corresponding to the target feature category, the intelligent detection system can play back fetal ultrasound images of all standard slices corresponding to the target feature category frame by frame ;
  • the intelligent detection system can play back the fetal ultrasound images of all chapters corresponding to the target feature category chapter by chapter.
  • the intelligent detection system can directly play back the optimal frame fetal ultrasound image corresponding to the target feature category, or it can play frame by frame or chapter by chapter. After playing back the fetal ultrasound image corresponding to the target feature category, the intelligent detection system plays back the optimal frame fetal ultrasound image corresponding to the target feature category.
  • the optimal frame of fetal ultrasound image is positioned and played back, which enriches the playback mode of the optimal frame of fetal ultrasound image while ensuring the playback efficiency of the optimal frame of fetal ultrasound image.
  • the embodiment of the present invention further determines whether a playback request for a fetal ultrasound image of a certain target feature category is detected, and if detected, the output terminal is controlled to play back the fetal ultrasound image of the target feature category.
  • playback of the fetal ultrasound images helps to accurately determine the abnormal fetal growth and development.
  • the intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the detection result.
  • the target feature category corresponds to The playback request triggered by the fetal ultrasound image can be triggered in real time or when the fetal ultrasound image analysis is completed, that is, the fetal ultrasound image corresponding to the target feature category can be real-time or the target feature category in the final fetal ultrasound image in the fetal ultrasound image.
  • Ultrasound image
  • step 204 and step 205 may occur simultaneously, that is, the detection result in step 205 may also include the optimal frame fetal ultrasound image corresponding to a certain target feature category. It should be further noted that, step 202 may also occur after step 205 . When step 202 occurs at the same time as step 205, step 204 occurs after step 205.
  • step 201 and step 205 please refer to the detailed description of step 101 to step 102 in Embodiment 1, which is not repeated in this embodiment of the present invention.
  • the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, including:
  • the intelligent detection system determines the section score of each standard section in all standard sections corresponding to the target feature category, and according to the target feature category
  • the slice score of each standard slice in all standard slices corresponding to the category, and the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score is determined from all the standard slices as the optimal frame fetal ultrasound corresponding to the target feature category image.
  • the cut surface score of each standard cut surface is calculated, specifically: based on determining The weight value corresponding to each structural feature of each standard section, the category probability of the structural feature, and the position probability of the structural feature are calculated, and the structural score corresponding to each structural feature of each standard section is calculated; The sum of the structural scores corresponding to all the structural features of the section is taken as the section score of the standard section.
  • each standard slice corresponds to a frame of fetal ultrasound image.
  • the weight value corresponding to each structural feature of each standard section is used to represent the expression level of the structural feature in the standard section. The higher the weight value corresponding to the structural feature, the higher the corresponding expression level, that is, the structural feature is in The proportion of the corresponding standard section is higher.
  • the feature parameter of each structural feature of each standard slice includes the class probability of the structural feature and the position probability of the structural feature.
  • the calculation formula of the slice score of the standard slice of each frame of fetal ultrasound image is as follows:
  • H i P i ⁇ Q i ⁇ O i ;
  • S is the section score of each standard section
  • H i is the structural score of the i-th structural feature in each standard section
  • M is the total number of structural features in each standard section
  • P i is each The class probability (also known as confidence) of the ith structural feature in the standard section
  • Q i is the position probability of the ith structural feature in each standard section
  • O i is the weight of the ith structural feature in each standard section value
  • N is the total number of key weight value influencing factors of the ith structural feature
  • O ij is the sub-weight value corresponding to the jth key weight value influencing factor in the ith structural feature in each standard section.
  • the parameters included in the structural feature in each standard section also include the probability of the position where the structural feature is located.
  • the structural score of the i-th structural feature in each standard section is The calculation formula is:
  • H i P i ⁇ Q i ⁇ O i ⁇ C i ;
  • C i is the parameter included in the structural feature in each standard section, and also includes the probability of the position where the structural feature is located. In this way, the more parameters of the structural feature, the more accurate the calculation of the structural score of the structural feature will be, the more accurate the calculation of the sectional score of the standard section will be, and the more accurate and reliable the determination of the optimal standard section will be. .
  • the calculation of the cut surface score of the standard cut surface can be realized, which is beneficial to improve the accuracy and efficiency of the calculation of the cut surface score of the standard cut surface; and according to different structural characteristics, Selecting different parameters can improve the calculation accuracy and efficiency of the structural score corresponding to the structural feature, thereby further improving the calculation accuracy and efficiency of the section score of the standard section.
  • this optional embodiment can improve the accuracy and efficiency of determining the optimal frame fetal ultrasound image by using the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score as the optimal frame fetal ultrasound image, thereby improving the accuracy and efficiency of determining the optimal frame fetal ultrasound image. Improve the output accuracy and efficiency of optimal frame fetal ultrasound images.
  • the intelligent detection system determines the frame corresponding to the standard slice corresponding to the highest slice score from all the standard slices according to the slice score of each standard slice in all standard slices corresponding to the target feature category
  • the output control method for the detection result of the fetal ultrasound image may further include the following operations:
  • the intelligent detection system determines whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include at least two matching standard section categories or at least two matching chapter categories;
  • the intelligent detection system triggers the execution of the above-mentioned slice score of each standard slice in all standard slices corresponding to the target feature category, and determines the standard slice corresponding to the highest slice score from all the standard slices.
  • the frame fetal ultrasound image is used as the operation of the optimal frame fetal ultrasound image corresponding to the target feature category;
  • the intelligent detection system determines the section score of each standard section in all standard sections corresponding to each matching feature category corresponding to the target feature category, and determines the section score of each standard section corresponding to each matching feature category according to the score of each standard section corresponding to each matching feature category Slice score, screen the fetal ultrasound image frame corresponding to the highest slice score from all the standard slices, and determine the fetal ultrasound image frame corresponding to all matching feature categories as the optimal frame fetal ultrasound image corresponding to the target feature category.
  • the number of optimal frame fetal ultrasound images corresponding to the feature category is greater than one.
  • the optimal frame of fetal ultrasound images corresponding to the structural features of gastric vesicles it is necessary to determine the optimal frame of fetal ultrasound images corresponding to the structural features of gastric vesicles. Since the standard slices corresponding to the structural characteristics of gastric vesicles include standard abdominal girth slices and gallbladder-umbilical vein slices, the optimal frame of fetal ultrasound images corresponding to the structural characteristics of gastric vesicles is required.
  • the ultrasound images include the optimal frame fetal ultrasound image corresponding to the standard abdominal girth section and the optimal frame fetal ultrasound image corresponding to the gallbladder-umbilical vein section, that is, the number of optimal frame fetal ultrasound images corresponding to the structural features of the gastric bubble is 2.
  • this optional embodiment first determines whether there are multiple standard slice categories and/or chapter categories corresponding to the structural feature, and if not, directly determines the optimal frame fetal ultrasound image corresponding to the structural feature, which can Improve the efficiency and accuracy of determining the optimal frame fetal ultrasound image corresponding to the structural feature; if so, determine the optimal frame fetal ultrasound image corresponding to different standard slice categories and/or chapter categories, thereby further improving the optimal frame fetal ultrasound image. accuracy of determination.
  • implementing the output control method for the detection result of the fetal ultrasound image described in FIG. 2 can quickly obtain accurate information of each feature (eg, structural feature, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image.
  • the detection results such as: abnormal, normal, suspected, checked, and unchecked, help to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed feature detection, In order to improve the probability of successful detection of the desired detection features, it is further beneficial to accurately determine the growth and development of the fetus.
  • FIG. 3 is a schematic structural diagram of a device for outputting a detection result of a fetal ultrasound image according to an embodiment of the present invention.
  • the output control device of the detection result of the fetal ultrasound image described in FIG. 3 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server can include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited).
  • the output control device for the detection result of the fetal ultrasound image may include an analysis module 301, an acquisition module 302 and a control module 303, wherein:
  • the analysis module 301 is configured to input the received fetal ultrasound image into the determined image analysis model for analysis.
  • the obtaining module 302 is configured to obtain the analysis result output by the image analysis model as the detection result of the fetal ultrasound image.
  • the control module 303 is configured to control the output terminal corresponding to the intelligent detection system to output the detection result.
  • the detection result of the fetal ultrasound image includes the detection result of multiple features of the fetal ultrasound image
  • the detection result of each feature includes the detection identifier of the feature
  • the detection identifier corresponding to each feature is used to indicate that the feature is One of the features to be checked, checked and normal features, checked and suspected features, and checked and abnormal features.
  • the checked and suspected features are features that have been detected and are of uncertain category
  • the checked and abnormal features are features that have been detected.
  • the output interface of the output terminal includes a first area and a second area, the first area is used for outputting detection results, and the second area is used for outputting a list of features to be checked corresponding to the fetal ultrasound image and a second area.
  • Checked feature list is used to store a plurality of unchecked features of the determined fetal ultrasound image
  • checked feature list is used to store multiple checked features of the fetal ultrasound image
  • the to-be-checked feature list includes
  • the categories of all features to be checked include the categories of all features to be checked included in the checked feature list
  • the categories of multiple features included in the fetal ultrasound image include the categories of all features to be checked included in the feature list to be checked.
  • the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 3 can quickly obtain accurate information of each feature (eg, structural feature, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image.
  • the detection results such as: abnormal, normal, suspected, checked, and unchecked, help to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed feature detection, In order to improve the probability of successful detection of the desired detection features, it is further beneficial to accurately determine the growth and development of the fetus.
  • the apparatus further includes a first determination module 304 and a first determination module 305, wherein:
  • the first judging module 304 is configured to judge, according to the target information of all the features included in the fetal ultrasound image, whether there is a determined key detection feature in all the features.
  • the control module 303 is further configured to control the output terminal to output a schematic section diagram corresponding to each key detection feature when the first determination module 304 determines that all the features included in the fetal ultrasound image have at least one key detection feature, and each key detection feature
  • the corresponding section schematic diagram includes the output identification of each structural feature in the standard section corresponding to the key detection feature.
  • the first determination module 305 is configured to determine the detection status of the structural feature corresponding to the output marker according to the change of each output marker included in the schematic sectional view corresponding to each key detection feature.
  • the structure corresponding to each output flag is used to indicate that the structural feature is detected in the corresponding standard section.
  • the output control device implementing the detection result of the fetal ultrasound image described in FIG. 4 determines whether there is a key detection feature in all the features included in the fetal ultrasound image, and if so, outputs a schematic diagram of the section corresponding to the key detection feature, which is conducive to clear determination. All structural features included in the corresponding standard section are detected, and the occurrence of the situation where it is impossible to clearly confirm whether the structural features required to be detected in the standard section due to too many structural features included in the section is reduced, and it is convenient for the relevant personnel to know the important
  • the feature detection situation of the detection feature is further beneficial to improve the accuracy of determining the growth and development situation of the fetus.
  • all the features included in the above-mentioned fetal ultrasound image include multiple structural features of the fetal ultrasound image, the detection result of each feature further includes a feature parameter of the feature, and the feature parameter of each feature includes the Class information for the feature.
  • the apparatus further includes a second determination module 306, wherein:
  • the obtaining module 302 is further configured to, after obtaining the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine the part feature of the fetal ultrasound image of the frame where each structural feature included in the fetal ultrasound image is located.
  • the second determination module 306 is configured to determine a feature parameter of each part feature, where the feature parameter of each part feature includes category information of the part feature.
  • the second determination module 306 is further configured to determine the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the detection of the standard section of the feature result.
  • the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 can improve the standard of the fetus by determining the standard section of the structural feature according to the category information of the structural feature and the category information of the part feature of the fetal ultrasound image in the frame. The accuracy and reliability of the determination of the slice are further improved, thereby further improving the accuracy and reliability of the detection results of fetal ultrasound images.
  • the apparatus may further include a second determination module 307 and a third determination module 308, wherein:
  • the second judgment module 307 is configured to, after the acquisition module 302 acquires the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine whether a playback request triggered by the fetal ultrasound image corresponding to a certain target feature category is detected,
  • the playback request is used to request playback of a fetal ultrasound image corresponding to a target feature category
  • the fetal ultrasound image corresponding to the target feature category includes the optimal frame fetal ultrasound image corresponding to the target feature category, and fetal ultrasound images of all standard slices corresponding to the target feature category Image, at least one of the fetal ultrasound images of all chapters corresponding to the target feature category
  • the fetal ultrasound image includes the fetal ultrasound image corresponding to the target feature category
  • the target feature category includes the target structural feature category and/or the target standard slice category
  • each The chapters include the same categories of standard views for each fetal ultrasound image.
  • the third determination module 308 is configured to determine the fetal ultrasound image corresponding to the target feature category according to the playback request when the determination result of the second determination module 307 is yes.
  • the control module 303 is further configured to control the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
  • the output control device implementing the detection result of the fetal ultrasound image described in FIG. 4 further determines whether a playback request for a fetal ultrasound image of a certain target feature category is detected after obtaining the detection result of the fetal ultrasound image. , control the output terminal to play back the fetal ultrasound images of the target feature category, which can facilitate the relevant personnel to review the fetal ultrasound images, especially when the fetal growth and development corresponding to the stored fetal ultrasound images are abnormal. Identify abnormalities in fetal growth and development.
  • the third determination module 308 may include a determination sub-module 3081, wherein:
  • the determining submodule 3081 is configured to determine the slice score of each standard slice in all standard slices corresponding to the target characteristic type when the fetal ultrasound image corresponding to the target characteristic type is the optimal frame fetal ultrasonic image corresponding to the target characteristic type.
  • the determination sub-module 3081 is further configured to determine, from all the standard slices, the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score according to the slice score of each standard slice in all standard slices corresponding to the marked feature category , as the optimal frame fetal ultrasound image corresponding to the target feature category.
  • the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 can improve the optimal frame fetal ultrasound image by using the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score as the optimal frame fetal ultrasound image. Accuracy and efficiency of ultrasound image determination, thereby improving the output accuracy and efficiency of optimal frame fetal ultrasound images.
  • the third determining module 308 further includes a judging sub-module 3082 and a screening sub-module 3083, wherein:
  • the judging submodule 3082 is used to determine the frame corresponding to the standard section corresponding to the highest section score from all the standard sections according to the section score of each standard section in all the standard sections corresponding to the target feature category in the determining submodule 3081
  • the fetal ultrasound image before the optimal frame fetal ultrasound image corresponding to the target feature category, and when the target feature category is the target structural feature category, determine whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include At least two matching standard section categories or at least two matching chapter categories; when the judgment result is no, trigger the determination sub-module 3081 to execute the above-mentioned section score of each standard section in all standard sections corresponding to the target feature category, from The operation of determining the frame of fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score among all the standard slices as the optimal frame of fetal ultrasound image corresponding to the target feature category.
  • the determination sub-module 3081 is further configured to determine the slice score of each standard slice in all standard slices corresponding to each matching feature category corresponding to the target feature category when the determination result of the determination sub-module 3082 is yes.
  • Screening submodule 3083 for screening the fetal ultrasound image of the frame corresponding to the highest slice score from all the standard slices according to the slice score of each standard slice corresponding to each matching feature category;
  • the determination sub-module 3081 is further configured to determine the frames of fetal ultrasound images corresponding to all matching feature categories as the optimal frame fetal ultrasound images corresponding to the target feature category, and the number of optimal frame fetal ultrasound images corresponding to the target feature category is greater than 1.
  • the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 first determines whether there are multiple standard slice categories and/or chapter categories corresponding to the structural feature, and if not, directly determines that the structural feature corresponds to
  • the optimal frame fetal ultrasound image can improve the efficiency and accuracy of determining the optimal frame fetal ultrasound image corresponding to the structural features; if so, determine the optimal frame fetal ultrasound image corresponding to different standard slice categories and/or chapter categories respectively. , thereby further improving the accuracy of determining the optimal frame fetal ultrasound image.
  • the apparatus further includes a third judging module 309, a screening module 310 and a sorting module 311, wherein:
  • the third judging module 309 is configured to, after the obtaining module 302 obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine whether there is any abnormal feature in all the features included in the fetal ultrasound image.
  • the screening module 310 is configured to screen all abnormal features from all features included in the fetal ultrasound image when the third determination module 309 determines that the result is yes.
  • the sorting module 311 is configured to sort all abnormal features according to the determined sorting method, and obtain all sorted abnormal features.
  • the control module 303 is configured to control the output terminal to output all sorted abnormal features.
  • the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 further sorts all the abnormal features after detecting that all the features in the fetal ultrasound image have abnormal features, and outputs the sorted abnormal features, It is helpful for relevant personnel to quickly know the abnormal characteristics of fetal ultrasound images, so as to further quickly and clearly know the abnormal situation of fetal growth and development.
  • FIG. 5 is another apparatus for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention.
  • the output control device of the detection result of the fetal ultrasound image described in FIG. 5 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server may include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited).
  • the output control device for the detection result of the fetal ultrasound image may include:
  • a memory 501 storing executable program code
  • processor 502 coupled to the memory 501;
  • an input interface 503 coupled with the processor 502 and an output interface 504;
  • the processor 502 invokes the executable program code stored in the memory 501 to execute some or all of the steps in the output control method for the detection result of the fetal ultrasound image described in the first embodiment or the second embodiment.
  • FIG. 6 is a schematic structural diagram of an intelligent detection system disclosed in an embodiment of the present invention.
  • the intelligent detection system may include an output control device for the detection result of the fetal ultrasound image, and is used to implement the output control method for the detection result of the fetal ultrasound image described in the embodiment of FIG. 1 or FIG. 2 .
  • the output control device for the detection result of the fetal ultrasound image may be the output control device for the detection result of the fetal ultrasound image described in any one of FIG. 3 or FIG. 4 , which is not limited in the embodiment of the present invention.
  • An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute the detection result of the fetal ultrasound image described in the first or second embodiment. Some or all of the steps in the output control method.
  • An embodiment of the present invention discloses a computer program product.
  • the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the description in the first embodiment or the second embodiment. Part or all of the steps in the output control method of the detection result of the fetal ultrasound image.
  • modules described as separate components may or may not be physically separated, and the components output as modules may or may not be physical modules, that is, they may be located in One place, or it can be distributed over multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
  • Read-Only Memory ROM
  • Random Access Memory Random Access Memory
  • PROM Programmable Read-only Memory
  • EPROM Erasable Programmable Read Only Memory
  • OTPROM One-time Programmable Read-Only Memory
  • EEPROM Electronically Erasable Programmable Read-Only Memory
  • CD-ROM Compact Disc Read -Only Memory
  • the output control method, device and system for outputting detection results of fetal ultrasound images disclosed in the embodiments of the present invention are only preferred embodiments of the present invention. , only used to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand; it can still be described in the foregoing embodiments.
  • the technical solutions of the present invention are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Biology (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Gynecology & Obstetrics (AREA)
  • Pregnancy & Childbirth (AREA)
  • Quality & Reliability (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

A method and apparatus for controlling the output of a detection result of a fetal ultrasound image, and a system. The method comprises: inputting a received fetal ultrasound image into a determined image analysis model for analysis, acquiring an analysis result output by the image analysis model, and taking same as a detection result of the fetal ultrasound image; and controlling an output terminal to output the detection result, wherein the detection result includes a detection result of each feature of the fetal ultrasound image; the detection result of each feature includes a detection identifier of the feature; the detection identifier corresponding to each feature is used to indicate that the feature is one among a feature to be subjected to detection, a feature which has been subjected to detection and is normal, a feature which has been subjected to detection and is suspect, and a feature which has been subjected to detection and is abnormal; the feature which has been subjected to detection and is suspect is a feature which has been subjected to detection and is of an uncertain category; and the feature which has been subjected to detection and is abnormal is a feature which has been subjected to detection and has an abnormal structural feature. It can be seen that by means of the method, an accurate detection result of features of a fetal ultrasound image can be quickly acquired, thereby facilitating accurate determination of the growth and development condition of a fetus.

Description

胎儿超声影像的检测结果的输出控制方法、装置及系统Method, device and system for output control of detection result of fetal ultrasound image 技术领域technical field
本发明涉及图像处理技术领域,尤其涉及一种胎儿超声影像的检测结果的输出控制方法、装置及系统。The present invention relates to the technical field of image processing, and in particular, to a method, device and system for outputting a detection result of a fetal ultrasound image.
背景技术Background technique
随着社会的进步以及人们获取健康新生儿意识的加强,越来越多的孕妇通过定期产检,获取胎儿的生长发育情况。With the progress of society and the strengthening of people's awareness of obtaining healthy newborns, more and more pregnant women obtain the growth and development of their fetuses through regular obstetric examinations.
目前胎儿生长发育情况的获取方法为:利用超声波收集回声的原理,将胎儿的断层图像显示在屏幕上,得到胎儿动态影像之后,再由具有相关经验的工作人员结合自身经验分析胎儿超声图像的检测结果,从而确定胎儿的生长发育情况。然而,实践发现,由于工作人员的经验有限和/或疲劳工作,这很容易导致无法获取到高准确性的胎儿超声图像的检测结果,从而无法准确确定胎儿的生长发育情况。At present, the acquisition method of fetal growth and development is as follows: using the principle of ultrasonic collection of echoes, displaying fetal tomographic images on the screen, and obtaining fetal dynamic images, then the staff with relevant experience will analyze the detection of fetal ultrasound images based on their own experience. As a result, the growth and development of the fetus can be determined. However, it has been found in practice that, due to limited experience and/or fatigue of the staff, this can easily lead to the failure to obtain high-accuracy fetal ultrasound image detection results, so that the fetal growth and development cannot be accurately determined.
发明内容SUMMARY OF THE INVENTION
本发明所要解决的技术问题在于,提供一种胎儿超声影像的检测结果的输出控制方法、装置及系统,能够获取到准确的胎儿超声图像的检测结果,以实现准确确定胎儿的生长发育情况。The technical problem to be solved by the present invention is to provide an output control method, device and system of fetal ultrasound image detection results, which can obtain accurate fetal ultrasound image detection results to accurately determine fetal growth and development.
为了解决上述技术问题,本发明第一方面公开了一种胎儿超声影像的检测结果的输出控制方法,所述方法应用于智能检测系统中,所述方法包括:In order to solve the above-mentioned technical problems, the first aspect of the present invention discloses a method for outputting a detection result of a fetal ultrasound image. The method is applied to an intelligent detection system, and the method includes:
所述智能检测系统将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析,并获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果;The intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image;
所述智能检测系统控制与所述智能检测系统对应的输出终端输出所述检测结果;The intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the detection result;
其中,所述检测结果包括所述胎儿超声影像的多个特征的检测结果,每个所述特征的检测结果包括该特征的检测标识,每个所述特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种,所述已检且疑似特征为被检测到且不确定类别的特征,所述已检且异常特征为已经被检测且存在异常结构特征的特征。The detection result includes detection results of multiple features of the fetal ultrasound image, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of a feature to be checked, a checked and normal feature, a checked and suspected feature, and a checked and abnormal feature, the checked and suspected feature is a feature of a detected and uncertain category, the checked and Anomalous features are features that have been detected and that have anomalous structural features.
作为一种可选的实施方式,在本发明第一方面中,所述方法还包括:As an optional implementation manner, in the first aspect of the present invention, the method further includes:
所述智能检测系统根据所述胎儿超声影像包括的所有所述特征的目标信息,判断所有所述特征中是否存在确定出的重点检测特征;The intelligent detection system judges whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image;
当判断出所述胎儿超声影像包括的所有所述特征存在至少一个所述重点检测特征时,所述智能检测系统控制所述输出终端输出与每个所述重点检测特征对应的切面示意图,每个所述重点检测特征对应的切面示意图包括该重点检测特征对应的标准切面中每个结构特征的输出标识;When it is determined that all the features included in the fetal ultrasound image have at least one of the key detection features, the intelligent detection system controls the output terminal to output a schematic diagram of a section corresponding to each of the key detection features, and each The schematic diagram of the section corresponding to the key detection feature includes the output identification of each structural feature in the standard section corresponding to the key detection feature;
所述智能检测系统根据每个所述重点检测特征对应的切面示意图包括的每个所述输出标识的变化情况确定该输出标识对应的结构特征的检测情况;The intelligent detection system determines the detection situation of the structural feature corresponding to the output mark according to the change of each of the output marks included in the schematic section diagram corresponding to each of the key detection features;
其中,对于任一所述重点检测特征,当所述重点检测特征对应的切面 示意图包括的每个所述输出标识的变化情况用于表示该输出标识从第一状态变为第二状态时,每个所述输出标识对应的结构特征的检测情况用于表示该结构特征在对应的标准切面中被检测到。Wherein, for any one of the key detection features, when the change of each of the output signs included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output sign changes from the first state to the second state, each The detection situation of the structural feature corresponding to each of the output identifiers is used to indicate that the structural feature is detected in the corresponding standard section.
作为一种可选的实施方式,在本发明第一方面中,所述输出终端的输出界面包括第一区域和第二区域,所述第一区域用于输出所述检测结果,所述第二区域用于输出所述胎儿超声影像对应的待检特征清单和已检特征清单,所述待检特征清单用于存储确定出的所述胎儿超声图像的多个待检特征,所述已检特征清单用于存储所述胎儿超声图像的多个已检特征,且所述待检特征清单所包括的所有待检特征的类别包括所述已检特征清单所包括的所有所述已检特征的类别,所述胎儿超声影像包括的多个所述特征的类别包括所述待检特征清单所包括的所有所述待检特征的类别。As an optional implementation manner, in the first aspect of the present invention, the output interface of the output terminal includes a first area and a second area, the first area is used for outputting the detection result, and the second area is used for outputting the detection result. The area is used to output a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image. The list is used to store a plurality of checked features of the fetal ultrasound image, and the categories of all the features to be checked included in the feature list to be checked include the categories of all the checked features included in the checked feature list , the categories of the multiple features included in the fetal ultrasound image include all categories of the features to be checked included in the feature list to be checked.
作为一种可选的实施方式,在本发明第一方面中,所述胎儿超声影像包括的所有所述特征包括所述胎儿超声影像的多个结构特征,每个所述特征的检测结果还包括该特征的特征参数,每个所述特征的特征参数包括该特征的类别信息;As an optional implementation manner, in the first aspect of the present invention, all the features included in the fetal ultrasound image include multiple structural features of the fetal ultrasound image, and the detection result of each of the features further includes The feature parameter of the feature, the feature parameter of each feature includes the category information of the feature;
以及,所述智能检测系统获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,所述方法还包括:And, after the intelligent detection system obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, the method further includes:
所述智能检测系统确定所述胎儿超声影像包括的每个所述结构特征所在帧胎儿超声图像的部位特征,并确定每个所述部位特征的特征参数,每个所述部位特征的特征参数包括该部位特征的类别信息;The intelligent detection system determines the part feature of the fetal ultrasound image of the frame where each of the structural features included in the fetal ultrasound image is located, and determines the feature parameter of each of the part features, and the feature parameters of each of the part features include: Category information of the feature of the part;
所述智能检测系统根据每个所述特征的类别信息以及该特征对应的部位特征的类别信息,确定每个所述特征的标准切面,每个所述特征的检测结果还包括该特征的标准切面的检测结果。The intelligent detection system determines the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the standard section of the feature. test results.
作为一种可选的实施方式,在本发明第一方面中,所述智能检测系统获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,所述方法还包括:As an optional implementation manner, in the first aspect of the present invention, after the intelligent detection system obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, the method further includes:
所述智能检测系统判断是否检测到针对某一目标特征类别对应的胎儿超声图像触发的回放请求,所述回放请求用于请求回放所述目标特征类别对应的胎儿超声图像,且所述目标特征类别对应的胎儿超声图像包括所述目标特征类别对应的最优帧胎儿超声图像、所述目标特征类别对应的所有标准切面的胎儿超声图像、所述目标特征类别对应的所有章节的胎儿超声图像中的至少一种,所述胎儿超声影像包括所述目标特征类别对应的胎儿超声图像,所述目标特征类别包括目标结构特征类别和/或目标标准切面类别,每个所述章节包括的每个所述胎儿超声图像的标准切面的类别相同;The intelligent detection system determines whether a playback request triggered by a fetal ultrasound image corresponding to a certain target feature category is detected, and the playback request is used to request playback of the fetal ultrasound image corresponding to the target feature category, and the target feature category The corresponding fetal ultrasound images include the optimal frame fetal ultrasound images corresponding to the target feature category, fetal ultrasound images of all standard slices corresponding to the target feature category, and fetal ultrasound images of all chapters corresponding to the target feature category. At least one, the fetal ultrasound image includes a fetal ultrasound image corresponding to the target feature category, the target feature category includes a target structural feature category and/or a target standard slice category, and each of the sections included in each of the The same categories of standard slices of fetal ultrasound images;
当判断结果为是时,所述智能检测系统根据所述回放请求确定所述目标特征类别对应的胎儿超声图像,并控制所述输出终端回放所述目标特征类别对应的胎儿超声图像。When the judgment result is yes, the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, and controls the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
作为一种可选的实施方式,在本发明第一方面中,所述智能检测系统根据所述回放请求确定所述目标特征类别对应的胎儿超声图像,包括:As an optional implementation manner, in the first aspect of the present invention, the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, including:
当所述目标特征类别对应的胎儿超声图像为所述目标特征类别对应的最优帧胎儿超声图像时,所述智能检测系统确定所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值;When the fetal ultrasound image corresponding to the target feature category is the optimal frame fetal ultrasound image corresponding to the target feature category, the intelligent detection system determines that each of the standard slices corresponding to the target feature category The slice score of the standard slice;
所述智能检测系统根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像。The intelligent detection system determines the frame fetus corresponding to the standard slice corresponding to the highest slice score from all the standard slices according to the slice score of each of the standard slices corresponding to the target feature category. The ultrasound image is taken as the optimal frame fetal ultrasound image corresponding to the target feature category.
作为一种可选的实施方式,在本发明第一方面中,所述智能检测系统根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像之前,所述方法还包括:As an optional implementation manner, in the first aspect of the present invention, the intelligent detection system, according to the slice score of each of the standard slices in all the standard slices corresponding to the target feature category, from all the standard slices Before determining the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score among the standard slices as the optimal frame fetal ultrasound image corresponding to the target feature category, the method further includes:
当所述目标特征类别为所述目标结构特征类别时,所述智能检测系统判断所述目标特征类别是否对应至少两个匹配特征类别,至少两个所述匹配特征类别包括至少两个匹配标准切面类别或至少两个匹配章节类别;When the target feature category is the target structure feature category, the intelligent detection system determines whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include at least two matching standard slices category or at least two matching chapter categories;
当判断结果为否时,触发执行所述的根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像的操作;When the judgment result is no, trigger the execution of the slice score of each of the standard slices in all the standard slices corresponding to the target feature category, and determine the slice corresponding to the highest slice score from all the standard slices The frame fetal ultrasound image corresponding to the standard slice is used as the operation of the optimal frame fetal ultrasound image corresponding to the target feature category;
当判断结果为是时,所述智能检测系统确定所述目标特征类别对应的每个所述匹配特征类别对应的所有标准切面中每个所述标准切面的切面分值,并根据每个所述匹配特征类别对应的每个所述标准切面的切面分值,从所有该标准切面中筛选最高切面分值对应的帧胎儿超声图像,并确定所有所述匹配特征类别对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像,该目标特征类别对应的最优帧胎儿超声图像的数量大于1。When the judgment result is yes, the intelligent detection system determines the slice score of each of the standard slices in all standard slices corresponding to each of the matching feature categories corresponding to the target feature category, and determines the slice score of each of the standard slices according to each of the standard slices. The slice score of each of the standard slices corresponding to the matching feature categories is selected, the frame fetal ultrasound images corresponding to the highest slice score are selected from all the standard slices, and the frame fetal ultrasound images corresponding to all the matching feature categories are determined as The optimal frame fetal ultrasound image corresponding to the target feature category, and the number of the optimal frame fetal ultrasound image corresponding to the target feature category is greater than 1.
作为一种可选的实施方式,在本发明第一方面中,所述智能检测系统获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,所述方法还包括:As an optional implementation manner, in the first aspect of the present invention, after the intelligent detection system obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, the method further includes:
所述智能检测系统判断所述胎儿超声影像包括的所有所述特征中是否存在异常特征,当判断结果为是时,从所述胎儿超声影像包括的所有所述特征中筛选所有所述异常特征;The intelligent detection system determines whether there are any abnormal features in all the features included in the fetal ultrasound image, and when the determination result is yes, selects all the abnormal features from all the features included in the fetal ultrasound image;
所述智能检测系统按照确定出的排序方式对所有所述异常特征进行排序,得到排序后的所有所述异常特征,控制所述输出终端输出排序后的所有所述异常特征。The intelligent detection system sorts all the abnormal features according to the determined sorting method, obtains all the sorted abnormal features, and controls the output terminal to output all the sorted abnormal features.
本发明第二方面公开了一种胎儿超声影像的检测结果的输出控制装置,所述装置应用于智能检测系统中,且所述装置包括:A second aspect of the present invention discloses an output control device for detection results of fetal ultrasound images, the device is applied in an intelligent detection system, and the device includes:
分析模块,用于将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析;The analysis module is used for inputting the received fetal ultrasound image into the determined image analysis model for analysis;
获取模块,用于获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果;an acquisition module, configured to acquire the analysis result output by the image analysis model as the detection result of the fetal ultrasound image;
控制模块,用于控制与所述智能检测系统对应的输出终端输出所述检测结果;a control module, configured to control the output terminal corresponding to the intelligent detection system to output the detection result;
其中,所述检测结果包括所述胎儿超声影像的多个特征的检测结果,每个所述特征的检测结果包括该特征的检测标识,每个所述特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种,所述已检且疑似特征为被检测到且不确定类别的特征,所述已检且异常特征为已经被检测且存在异常结构特征的特征。The detection result includes detection results of multiple features of the fetal ultrasound image, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of a feature to be checked, a checked and normal feature, a checked and suspected feature, and a checked and abnormal feature, the checked and suspected feature is a feature of a detected and uncertain category, the checked and Anomalous features are features that have been detected and that have anomalous structural features.
作为一种可选的实施方式,在本发明第二方面中,所述装置还包括:As an optional implementation manner, in the second aspect of the present invention, the device further includes:
第一判断模块,用于根据所述胎儿超声影像包括的所有所述特征的目标信息,判断所有所述特征中是否存在确定出的重点检测特征;a first judgment module, configured to judge whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image;
所述控制模块,还用于当所述第一判断模块判断出所述胎儿超声影像 包括的所有所述特征存在至少一个所述重点检测特征时,控制所述输出终端输出与每个所述重点检测特征对应的切面示意图,每个所述重点检测特征对应的切面示意图包括该重点检测特征对应的标准切面中每个结构特征的输出标识;The control module is further configured to control the output terminal to output and each of the key points when the first determination module determines that all the features included in the fetal ultrasound image have at least one of the key detection features. A schematic diagram of a section corresponding to the detection feature, and the schematic diagram of a section corresponding to each of the key detection features includes the output identifier of each structural feature in the standard section corresponding to the key detection feature;
第一确定模块,用于根据每个所述重点检测特征对应的切面示意图包括的每个所述输出标识的变化情况确定该输出标识对应的结构特征的检测情况;a first determination module, configured to determine the detection situation of the structural feature corresponding to the output marker according to the change situation of each of the output markers included in the schematic section diagram corresponding to each of the key detection features;
其中,对于任一所述重点检测特征,当所述重点检测特征对应的切面示意图包括的每个所述输出标识的变化情况用于表示该输出标识从第一状态变为第二状态时,每个所述输出标识对应的结构特征的检测情况用于表示该结构特征在对应的标准切面中被检测到。Wherein, for any one of the key detection features, when the change of each of the output signs included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output sign changes from the first state to the second state, each The detection situation of the structural feature corresponding to each of the output identifiers is used to indicate that the structural feature is detected in the corresponding standard section.
作为一种可选的实施方式,在本发明第二方面中,所述输出终端的输出界面包括第一区域和第二区域,所述第一区域用于输出所述检测结果,所述第二区域用于输出所述胎儿超声影像对应的待检特征清单和已检特征清单,所述待检特征清单用于存储确定出的所述胎儿超声图像的多个待检特征,所述已检特征清单用于存储所述胎儿超声图像的多个已检特征,且所述待检特征清单所包括的所有待检特征的类别包括所述已检特征清单所包括的所有所述已检特征的类别,所述胎儿超声影像包括的多个所述特征的类别包括所述待检特征清单所包括的所有所述待检特征的类别。As an optional implementation manner, in the second aspect of the present invention, the output interface of the output terminal includes a first area and a second area, the first area is used for outputting the detection result, and the second area is used for outputting the detection result. The area is used to output a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image. The list is used to store a plurality of checked features of the fetal ultrasound image, and the categories of all the features to be checked included in the feature list to be checked include the categories of all the checked features included in the checked feature list , the categories of the multiple features included in the fetal ultrasound image include all categories of the features to be checked included in the feature list to be checked.
作为一种可选的实施方式,在本发明第二方面中,所述胎儿超声影像包括的所有所述特征包括所述胎儿超声影像的多个结构特征,每个所述特征的检测结果还包括该特征的特征参数,每个所述特征的特征参数包括该特征的类别信息;As an optional implementation manner, in the second aspect of the present invention, all the features included in the fetal ultrasound image include multiple structural features of the fetal ultrasound image, and the detection result of each of the features further includes The feature parameter of the feature, the feature parameter of each feature includes the category information of the feature;
以及,所述装置还包括:And, the device also includes:
所述获取模块,还用于在获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,确定所述胎儿超声影像包括的每个所述结构特征所在帧胎儿超声图像的部位特征;The acquisition module is further configured to, after acquiring the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine the fetal ultrasound image of the frame where each of the structural features included in the fetal ultrasound image is located. part features;
第二确定模块,用于确定每个所述部位特征的特征参数,每个所述部位特征的特征参数包括该部位特征的类别信息;a second determination module, configured to determine a feature parameter of each of the part features, and the feature parameters of each of the part features include category information of the part feature;
所述第二确定模块,还用于根据每个所述特征的类别信息以及该特征对应的部位特征的类别信息,确定每个所述特征的标准切面,每个所述特征的检测结果还包括该特征的标准切面的检测结果。The second determination module is further configured to determine the standard section of each of the features according to the category information of each of the features and the category information of the part feature corresponding to the feature, and the detection result of each of the features also includes: The detection result of the standard slice of this feature.
作为一种可选的实施方式,在本发明第二方面中,所述装置还包括:As an optional implementation manner, in the second aspect of the present invention, the device further includes:
第二判断模块,用于在所述获取模块获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,判断是否检测到针对某一目标特征类别对应的胎儿超声图像触发的回放请求,所述回放请求用于请求回放所述目标特征类别对应的胎儿超声图像,且所述目标特征类别对应的胎儿超声图像包括所述目标特征类别对应的最优帧胎儿超声图像、所述目标特征类别对应的所有标准切面的胎儿超声图像、所述目标特征类别对应的所有章节的胎儿超声图像中的至少一种,所述胎儿超声影像包括所述目标特征类别对应的胎儿超声图像,所述目标特征类别包括目标结构特征类别和/或目标标准切面类别,每个所述章节包括的每个所述胎儿超声图像的标准切面的类别相同;The second judgment module is configured to judge whether a fetal ultrasound image trigger corresponding to a certain target feature category is detected after the acquisition module obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image The playback request is used to request playback of the fetal ultrasound image corresponding to the target feature category, and the fetal ultrasound image corresponding to the target feature category includes the optimal frame fetal ultrasound image corresponding to the target feature category, all at least one of fetal ultrasound images of all standard slices corresponding to the target feature category and fetal ultrasound images of all chapters corresponding to the target feature category, and the fetal ultrasound image includes fetal ultrasound images corresponding to the target feature category, The target feature categories include target structural feature categories and/or target standard slice categories, and each of the chapters includes the same category of standard slices of each of the fetal ultrasound images;
第三确定模块,用于当所述第二判断模块判断结果为是时,根据所述回放请求确定所述目标特征类别对应的胎儿超声图像;a third determination module, configured to determine the fetal ultrasound image corresponding to the target feature category according to the playback request when the second determination module determines that the result is yes;
所述控制模块,还用于控制所述输出终端回放所述目标特征类别对应 的胎儿超声图像。The control module is further configured to control the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
作为一种可选的实施方式,在本发明第二方面中,所述第三确定模块包括:As an optional implementation manner, in the second aspect of the present invention, the third determining module includes:
确定子模块,用于当所述目标特征类别对应的胎儿超声图像为所述目标特征类别对应的最优帧胎儿超声图像时,确定所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值;A determination submodule, configured to determine each of all the standard slices corresponding to the target feature category when the fetal ultrasound image corresponding to the target feature category is the optimal frame fetal ultrasound image corresponding to the target feature category. The section score of the standard section;
所述确定子模块,还用于根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像。The determining sub-module is further configured to determine, from among all the standard sectional planes, the sectional plane score corresponding to the standard tangential plane with the highest sectional plane score according to the sectional plane score of each of the standard tangential planes corresponding to the target feature category. The corresponding frame of fetal ultrasound image is used as the optimal frame of fetal ultrasound image corresponding to the target feature category.
作为一种可选的实施方式,在本发明第二方面中,所述第三确定模块还包括:As an optional implementation manner, in the second aspect of the present invention, the third determining module further includes:
判断子模块,用于在所述确定子模块根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像之前,当所述目标特征类别为所述目标结构特征类别时,判断所述目标特征类别是否对应至少两个匹配特征类别,至少两个所述匹配特征类别包括至少两个匹配标准切面类别或至少两个匹配章节类别;当判断结果为否时,触发所述确定子模块执行所述的根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像的操作;The judging sub-module is used to determine, in the determining sub-module, the section score corresponding to the highest section score from all the standard sections according to the section score of each of the standard sections corresponding to the target feature category. Before the frame fetal ultrasound image corresponding to the standard slice is used as the optimal frame fetal ultrasound image corresponding to the target feature category, when the target feature category is the target structural feature category, determine whether the target feature category corresponds to at least one of the target feature categories. Two matching feature categories, at least two of the matching feature categories include at least two matching standard section categories or at least two matching chapter categories; when the judgment result is no, trigger the determining sub-module to execute the The slice score of each of the standard slices in all the standard slices corresponding to the target feature category, and the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score is determined from all the standard slices as the target feature The operation of the optimal frame fetal ultrasound image corresponding to the category;
所述确定子模块,还用于当所述判断子模块判断结果为是时,确定所述目标特征类别对应的每个所述匹配特征类别对应的所有标准切面中每个所述标准切面的切面分值;The determining sub-module is further configured to determine, when the determination result of the determining sub-module is yes, determine a section of each of the standard sections in all standard sections corresponding to each of the matching feature categories corresponding to the target feature category score;
筛选子模块,用于根据每个所述匹配特征类别对应的每个所述标准切面的切面分值,从所有该标准切面中筛选最高切面分值对应的帧胎儿超声图像;A screening submodule for screening the fetal ultrasound image frame corresponding to the highest slice score from all the standard slices according to the slice score of each of the standard slices corresponding to each of the matching feature categories;
所述确定子模块,还用于确定所有所述匹配特征类别对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像,该目标特征类别对应的最优帧胎儿超声图像的数量大于1。The determining submodule is further configured to determine all frames of fetal ultrasound images corresponding to the matching feature categories, as the optimal frame fetal ultrasound images corresponding to the target feature categories, and the optimal frame fetal ultrasound images corresponding to the target feature categories. The number is greater than 1.
作为一种可选的实施方式,在本发明第二方面中,所述装置还包括:As an optional implementation manner, in the second aspect of the present invention, the device further includes:
第三判断模块,用于在所述获取模块获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,判断所述胎儿超声影像包括的所有所述特征中是否存在异常特征;A third judgment module, configured to judge whether there is any abnormality in all the features included in the fetal ultrasound image after the acquisition module obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image feature;
筛选模块,用于当所述第三判断模块判断结果为是时,从所述胎儿超声影像包括的所有所述特征中筛选所有所述异常特征;a screening module, configured to screen all the abnormal features from all the features included in the fetal ultrasound image when the third judgment module determines that the result is yes;
排序模块,用于按照确定出的排序方式对所有所述异常特征进行排序,得到排序后的所有所述异常特征;a sorting module, configured to sort all the abnormal features according to the determined sorting method, and obtain all the sorted abnormal features;
所述控制模块,用于控制所述输出终端输出排序后的所有所述异常特征。The control module is configured to control the output terminal to output all the sorted abnormal features.
本发明第三方面公开了另一种胎儿超声影像的检测结果的输出控制装置,所述装置应用于智能检测系统中,且所述装置包括:A third aspect of the present invention discloses another device for outputting the detection results of fetal ultrasound images. The device is applied in an intelligent detection system, and the device includes:
存储有可执行程序代码的存储器;a memory in which executable program code is stored;
与所述存储器耦合的处理器;a processor coupled to the memory;
所述处理器调用所述存储器中存储的所述可执行程序代码,执行本发 明第一方面公开的胎儿超声影像的检测结果的输出控制方法。The processor invokes the executable program code stored in the memory to execute the output control method for the detection result of the fetal ultrasound image disclosed in the first aspect of the present invention.
本发明第四方面公开了一种计算机存储介质,所述计算机存储介质存储有计算机指令,所述计算机指令被调用时,用于执行本发明第一方面公开的胎儿超声影像的检测结果的输出控制方法。A fourth aspect of the present invention discloses a computer storage medium, where the computer storage medium stores computer instructions, and when the computer instructions are invoked, is used to execute the output control of the detection result of the fetal ultrasound image disclosed in the first aspect of the present invention method.
本发明第五方面公开了一种智能检测系统,用于执行本发明第一方面公开的胎儿超声影像的检测结果的输出控制方法。A fifth aspect of the present invention discloses an intelligent detection system for implementing the output control method of the detection result of the fetal ultrasound image disclosed in the first aspect of the present invention.
与现有技术相比,本发明实施例具有以下有益效果:Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
本发明实施例中,智能检测系统将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析,并获取该影像分析模型输出的分析结果,作为胎儿超声影像的检测结果,以及控制与智能检测系统对应的输出终端输出检测结果,其中,检测结果包括胎儿超声影像的多个特征的检测结果,每个特征的检测结果包括该特征的检测标识,每个特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种,已检且疑似特征为被检测到且不确定类别的特征,已检且异常特征为已经被检测且存在异常结构特征的特征。可见,实施本发明通过对胎儿超声影像进行自动分析,能够快速获取到准确的胎儿超声影像的每个特征(例如:结构特征、切面)的检测结果,例如:异常、正常、疑似、已检、未检,有利于实现准确确定胎儿的生长发育情况;以及通过对胎儿超声图像的每个特征进行标识,能够减少特征漏检的情况发生,以提高成功检测到所需检测特征的可能性,从而进一步有利于实现准确确定胎儿的生长发育情况。In the embodiment of the present invention, the intelligent detection system analyzes the received fetal ultrasound image input into the determined image analysis model, and obtains the analysis result output by the image analysis model, as the detection result of the fetal ultrasound image, and the control and intelligence The output terminal corresponding to the detection system outputs the detection result, wherein the detection result includes the detection result of multiple features of the fetal ultrasound image, the detection result of each feature includes the detection mark of the feature, and the detection mark corresponding to each feature is used to indicate the The feature is one of the feature to be detected, the detected and normal feature, the detected and suspected feature, and the detected and abnormal feature. The detected and suspected feature is the feature of the detected and uncertain category, and the detected and abnormal feature are features that have been detected and that have abnormal structural features. It can be seen that the implementation of the present invention can quickly obtain accurate detection results of each feature (for example: structural features, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image, such as: abnormal, normal, suspected, detected, Undetected, it is beneficial to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed detection of features, so as to improve the possibility of successfully detecting the required detection features, thereby It is further beneficial to realize the accurate determination of the growth and development of the fetus.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.
图1是本发明实施例公开的一种胎儿超声影像的检测结果的输出控制方法的流程示意图;1 is a schematic flowchart of a method for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention;
图2是本发明实施例公开的另一种胎儿超声影像的检测结果的输出控制方法的流程示意图;FIG. 2 is a schematic flowchart of another method for controlling the output of a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention;
图3是本发明实施例公开的一种胎儿超声影像的检测结果的输出控制装置的结构示意图;3 is a schematic structural diagram of a device for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention;
图4是本发明实施例公开的另一种胎儿超声影像的检测结果的输出控制装置的结构示意图;4 is a schematic structural diagram of another device for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention;
图5是本发明实施例公开的又一种胎儿超声影像的检测结果的输出控制装置的结构示意图;5 is a schematic structural diagram of another device for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention;
图6是本发明实施例公开的一种智能检测系统的结构示意图。FIG. 6 is a schematic structural diagram of an intelligent detection system disclosed in an embodiment of the present invention.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make those skilled in the art better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only These are some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是 用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、装置、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。The terms "first", "second" and the like in the description and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally also includes For other steps or units inherent to these processes, methods, products or devices.
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本发明的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor a separate or alternative embodiment that is mutually exclusive of other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
本发明公开了一种胎儿超声影像的检测结果的输出控制方法、装置及系统,能够通过对胎儿超声影像进行自动分析,能够快速获取到准确的胎儿超声影像的每个特征(例如:结构特征、切面)的检测结果,例如:异常、正常、疑似、已检、未检,有利于实现准确确定胎儿的生长发育情况;以及通过对胎儿超声图像的每个特征进行标识,能够减少特征漏检的情况发生,以提高成功检测到所需检测特征的可能性,从而进一步有利于实现准确确定胎儿的生长发育情况。以下分别进行详细说明。The invention discloses an output control method, device and system for the detection results of fetal ultrasound images, which can quickly acquire accurate fetal ultrasound images by automatically analyzing each feature of the fetal ultrasound images (for example, structural features, Section) detection results, such as: abnormal, normal, suspected, checked, unchecked, which is conducive to accurately determining the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the number of missed features. This occurs to increase the likelihood of successful detection of the desired detection feature, thereby further facilitating accurate determination of fetal growth and development. Each of them will be described in detail below.
实施例一Example 1
请参阅图1,图1是本发明实施例公开的一种胎儿超声影像的检测结果的输出控制方法的流程示意图。其中,图1所描述的胎儿超声影像的检测结果的输出控制方法可以应用于智能检测系统(智能检测设备/智能检测服务器,其中,该智能检测服务器可以包括本地智能检测服务器或云智能检测服务器,本发明实施例不做限定)中。如图1所示,该胎儿超声影像的检测结果的输出控制方法可以包括以下操作:Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of a method for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention. Wherein, the output control method of the detection result of the fetal ultrasound image described in FIG. 1 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server may include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited). As shown in FIG. 1 , the output control method of the detection result of the fetal ultrasound image may include the following operations:
101、智能检测系统将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析,并获取该影像分析模型输出的分析结果,作为胎儿超声影像的检测结果。101. The intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image.
本发明实施例中,可选的,胎儿超声影像可以是从与智能检测系统建立通信连接的实体终端设备和/或虚拟终端设备发送的影像。其中,该实体终端设备可以包括超声影像采集设备、与该超声影像采集设备具有通信连接的其他终端设备,例如:计算机。虚拟终端设备可以是网盘和/或云服务终端设备等。进一步的,该实体终端设备还可以包括可拔插存储设备,例如:U盘等。进一步的,胎儿超声影像可以是实时影像,也可以是非实时影像。当胎儿超声影像是实时影像时,实体终端设备优选超声影像采集设备。In this embodiment of the present invention, optionally, the fetal ultrasound image may be an image sent from a physical terminal device and/or a virtual terminal device that establishes a communication connection with the intelligent detection system. Wherein, the physical terminal device may include an ultrasonic image acquisition device, and other terminal devices having a communication connection with the ultrasonic image acquisition device, such as a computer. The virtual terminal device may be a network disk and/or a cloud service terminal device, or the like. Further, the physical terminal device may also include a pluggable storage device, such as a USB flash drive. Further, the fetal ultrasound image may be a real-time image or a non-real-time image. When the fetal ultrasound image is a real-time image, the physical terminal device preferably is an ultrasound image acquisition device.
本发明实施例中,可选的,胎儿超声影像的检测结果包括该胎儿超声影像的多个特征的检测结果。进一步可选的,胎儿超声影像的检测结果可以为胎儿超声影像的实时分析结果,也可以为对胎儿超声影像分析完毕后输出的分析结果。又进一步可选的,胎儿超声影像的多个特征包括胎儿超声影像的多个结构特征和/或多个标准切面。又进一步的,胎儿超声影像的多个特征还可以包括多个部位特征。这样通过输出结构特征、切面以及部位特征的检测结果,能够获取到更精准的超声影像的检测结果,从而更精准的知晓胎儿的生长发育情况。In this embodiment of the present invention, optionally, the detection result of the fetal ultrasound image includes detection results of multiple features of the fetal ultrasound image. Further optionally, the detection result of the fetal ultrasound image may be a real-time analysis result of the fetal ultrasound image, or may be an analysis result output after the analysis of the fetal ultrasound image is completed. Still further optionally, the multiple features of the fetal ultrasound image include multiple structural features and/or multiple standard slices of the fetal ultrasound image. Still further, the multiple features of the fetal ultrasound image may also include multiple location features. In this way, by outputting the detection results of structural features, slices and part features, more accurate ultrasound image detection results can be obtained, so as to more accurately know the growth and development of the fetus.
本发明实施例中,可选的,每个特征的检测结果包括该特征的检测标识,每个特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种。其中,已检且疑 似特征为被检测到且不确定类别的特征,已检且异常特征为已经被检测且存在异常结构特征的特征。具体的,当胎儿超声影像包括的所有特征为胎儿超声影像的多个结构特征时,已检且疑似特征为被检测到且其置信度(又称特征类别的概率)小于等于预设置信度阈值和/或与确定出的疑似特征相匹配的特征,已检且异常特征为已经被检测且存在异常的特征。例如:若A结构特征为脑中线小囊结构特征,且该脑中线小囊结构特征没有伴随其他结构特征(例如:丘脑结构特征等),则A结构特征为疑似脑中线小囊结构特征。当胎儿超声影像包括的所有特征为胎儿超声影像的多个标准切面时,已检且疑似特征为包括与该特征匹配的关键结构特征且不包括其他结构特征的特征,已检且异常特征为已经被检测且存在异常结构特征的特征。例如:若B标准切面包括胃泡结构特征和脐静脉结构特征,则B标准切面为疑似腹围标准切面;若B标准切面包括胃泡结构特征和脐静脉结构特征,还包括肝脏、降主动脉、肋骨、下腔静脉其他结构特征,则B标准切面为正常腹围标准切面;若B标准切面包括异常胃泡结构特征,则B标准切面为异常腹围标准切面。进一步可选的,同一特征的不同检测结果对应不同的检测标识。其中,检测标识可以包括图形标识、文字标识、图案标识中的至少一种。例如:当C结构特征的检测结果为正常胃泡结构特征时,C结构特征的检测标识为绿色方框;当C结构特征的检测结果为未检结构特征时,C结构特征的检测标识为灰色方框,当C结构特征的检测结果为疑似胃泡结构特征时,C结构特征的检测标识为黄色方框,当C结构特征的检测结果为异常胃泡结构特征时,C结构特征的检测标识为红色方框,且方框用于框选C结构特征。这样通过对同一特征的不同检测结果用不同的检测标识进行标注,能够精准且直观知晓对应特征的检测结果,从而知晓胎儿生长发育情况,例如:发育异常、发育正常、发育情况不明等。In the embodiment of the present invention, optionally, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is a feature to be detected, a detected and normal feature, a detected and suspected feature One of the signatures and detected and abnormal signatures. Among them, the detected and suspected features are features that have been detected and are of uncertain category, and the detected and abnormal features are features that have been detected and have abnormal structural features. Specifically, when all the features included in the fetal ultrasound image are multiple structural features of the fetal ultrasound image, the detected and suspected features are detected and their confidence (also known as the probability of a feature category) is less than or equal to a preset confidence threshold And/or a feature that matches the determined suspected feature, a detected and abnormal feature is a feature that has been detected and has an abnormality. For example, if the structural feature of A is the structural feature of the midline sac, and the structural feature of the midline sac is not accompanied by other structural features (for example, the structural feature of the thalamus, etc.), the structural feature of A is a suspected midline sac structural feature. When all the features included in the fetal ultrasound image are multiple standard slices of the fetal ultrasound image, the detected and suspected features are features that include key structural features that match the feature and do not include other structural features, and the detected and abnormal features are features that have been Features that are detected and present with abnormal structural features. For example: if the B standard view includes the structural features of the gastric bleb and the umbilical vein, the B standard view is the standard view of the suspected abdominal circumference; if the B standard view includes the structural features of the gastric bleb and the umbilical vein, it also includes the liver and descending aorta. , ribs, inferior vena cava and other structural features, the B standard section is the normal abdominal circumference standard section; if the B standard section includes the structural features of abnormal gastric vesicles, the B standard section is the abnormal abdominal circumference standard section. Further optionally, different detection results of the same feature correspond to different detection identifiers. Wherein, the detection mark may include at least one of a graphic mark, a text mark, and a pattern mark. For example: when the detection result of the C structure feature is a normal gastric vesicle structure feature, the detection mark of the C structure feature is a green box; when the detection result of the C structure feature is an undetected structure feature, the detection mark of the C structure feature is gray Box, when the detection result of the C structure feature is a suspected gastric vesicle structure feature, the detection mark of the C structure feature is a yellow box, and when the detection result of the C structure feature is an abnormal gastric vesicle structure feature, the detection mark of the C structure feature It is a red box, and the box is used to frame the C structure feature. In this way, by labeling different detection results of the same feature with different detection marks, the detection results of the corresponding features can be accurately and intuitively known, so as to know the fetal growth and development, such as abnormal development, normal development, unknown development, etc.
本发明实施例中,影像分析模型可以包括确定出的目标分析模型、实例分割模型以及语义分割模型等能够对胎儿超声影像进行分析的模型中的至少一种,本发明实施例不做限定。In this embodiment of the present invention, the image analysis model may include at least one of a determined target analysis model, an instance segmentation model, and a semantic segmentation model that can analyze fetal ultrasound images, which is not limited in this embodiment of the present invention.
102、智能检测系统控制与智能检测系统对应的输出终端输出上述检测结果。102. The intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the above detection result.
本发明实施例中,可选的,智能检测系统对应的输出终端包括智能检测系统一体的输出终端和/或与智能检测系统具有通信连接的独立于智能检测系统的输出终端。进一步可选的,输出终端包括显示终端和/或语音终端,优选具有语音功能的显示终端。In the embodiment of the present invention, optionally, the output terminal corresponding to the intelligent detection system includes an output terminal integrated with the intelligent detection system and/or an output terminal independent of the intelligent detection system that has a communication connection with the intelligent detection system. Further optionally, the output terminal includes a display terminal and/or a voice terminal, preferably a display terminal with a voice function.
本发明实施例中,输出终端的输出界面包括第一区域和第二区域,第一区域用于输出上述检测结果,第二区域用于输出胎儿超声影像对应的待检特征清单和已检特征清单,待检特征清单用于存储确定出的胎儿超声图像的多个待检特征,已检特征清单用于存储胎儿超声图像的多个已检特征,且待检特征清单所包括的所有待检特征的类别包括已检特征清单所包括的所有已检特征的类别,胎儿超声影像包括的多个特征的类别包括待检特征清单所包括的所有待检特征的类别。进一步的,当待检特征清单的某一待检特征类别对应的待检特征已经被检测完毕时,可以从待检特征清单清除该某一待检特征类别。需要说明的是,上述检测结果还包括胎儿超声影像对应的待检特征清单和已检特征清单。又进一步的,输出终端的输出界面设置有侧边导航栏,侧边导航栏包括待检测特征清单和/或已检特征清单,又进一步的,侧边导航栏还包括已检特征的留存情况,其中,已检特征的留存情况用于表示当需要输出该已检特征时,控制输出终端输出该已检特 征,当不需要输出该已检特征时,隐藏该已检特征。这样通过根据特征需要输出的情况,控制输出终端输出特征或者隐藏特征,能够提高特征的输出灵活性以及减少因输出终端的输出界面输出的内容太多而导致特征区分错误甚至无法区分的情况发生。又进一步的,不同检测项目对应不同的侧边导航栏,其中,检测项目包括中晚孕周检测、早孕周检测以及妇科检测中的至少一种,当需要检测到某一检测项目时,更换至对应的侧边导航栏。In the embodiment of the present invention, the output interface of the output terminal includes a first area and a second area, the first area is used for outputting the above-mentioned detection result, and the second area is used for outputting a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image , the feature list to be checked is used to store a plurality of features to be checked of the determined fetal ultrasound image, the checked feature list is used to store a plurality of checked features of the fetal ultrasound image, and all features to be checked included in the feature list to be checked The categories of the checked features include all the checked feature categories included in the checked feature list, and the multiple feature categories included in the fetal ultrasound image include all the unchecked feature categories included in the unchecked feature list. Further, when the to-be-checked feature corresponding to a certain to-be-checked feature category in the to-be-checked feature list has been detected, the certain to-be-checked feature category can be cleared from the to-be-checked feature list. It should be noted that the above detection result also includes a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image. Still further, the output interface of the output terminal is provided with a side navigation bar, and the side navigation bar includes a list of features to be detected and/or a list of features that have been checked, and further, the side navigation bar also includes the retention of checked features, Wherein, the retention of the checked feature is used to indicate that when the checked feature needs to be output, the output terminal is controlled to output the checked feature, and when the checked feature does not need to be output, the checked feature is hidden. In this way, by controlling the output terminal to output the feature or hide the feature according to the situation that the feature needs to be output, it can improve the output flexibility of the feature and reduce the occurrence of feature distinction errors or even indistinguishability due to too many output contents on the output interface of the output terminal. Still further, different detection items correspond to different side navigation bars, wherein the detection items include at least one of middle-late pregnancy test, early pregnancy test and gynecological test. When a test item needs to be detected, change to The corresponding side navigation bar.
在一个可选的实施例中,该胎儿超声影像的检测结果的输出控制方法还可以包括以下操作:In an optional embodiment, the output control method of the detection result of the fetal ultrasound image may further include the following operations:
智能检测系统根据胎儿超声影像包括的所有特征的目标信息,判断所有特征中是否存在确定出的重点检测特征;The intelligent detection system judges whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image;
当判断出胎儿超声影像包括的所有特征存在至少一个重点检测特征时,智能检测系统控制输出终端输出与每个重点检测特征对应的切面示意图,每个重点检测特征对应的切面示意图包括该重点检测特征对应的标准切面中每个结构特征的输出标识;When it is determined that all the features included in the fetal ultrasound image have at least one key detection feature, the intelligent detection system controls the output terminal to output a schematic diagram of a section corresponding to each key detection feature, and the schematic section diagram corresponding to each key detection feature includes the key detection feature The output identification of each structural feature in the corresponding standard section;
智能检测系统根据每个重点检测特征对应的切面示意图包括的每个输出标识的变化情况确定该输出标识对应的结构特征的检测情况;The intelligent detection system determines the detection situation of the structural feature corresponding to the output mark according to the change of each output mark included in the schematic section diagram corresponding to each key detection feature;
其中,对于任一重点检测特征,当重点检测特征对应的切面示意图包括的每个输出标识的变化情况用于表示该输出标识从第一状态变为第二状态时,每个输出标识对应的结构特征的检测情况用于表示该结构特征在对应的标准切面中被检测到。Wherein, for any key detection feature, when the change of each output flag included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output flag changes from the first state to the second state, the structure corresponding to each output flag The detection status of the feature is used to indicate that the structural feature is detected in the corresponding standard section.
该可选的实施例中,胎儿超声影像包括的每个特征的目标信息包括该特征的类别、该特征在胎儿超声影像对应的胎儿的位置以及该特征的复杂度中的至少一种。智能检测系统判断所有特征中是否存在确定出的重点检测特征,具体的:当判断出胎儿超声影像包括的所有特征的至少一个特征的类别为确定出的重点检测特征的类别时,和/或,当判断出胎儿超声影像包括的所有特征的至少一个特征所在胎儿超声影像中的位置为确定出的重点位置(例如:心脏)时,和/或,当判断出胎儿超声影像包括的所有特征的至少一个特征的复杂度的等级大于等于确定出的复杂度的等级阈值时,确定胎儿超声影像包括的所有特征存在至少一个重点检测特征。这样通过特征的类别、特征在胎儿超声影像对应的胎儿的位置和/或特征的复杂度等多种方式确定胎儿超声影像包括的所有特征中存在重点检测特征,能够提高胎儿超声影像包括的所有特征中存在重点检测特征的确定效率以及准确性,从而提高对应的切面示意图的输出准确性以及自傲率,进而便于相关人员直观知晓重点检测特征的情况。In this optional embodiment, the target information of each feature included in the fetal ultrasound image includes at least one of the category of the feature, the position of the fetus corresponding to the feature in the fetal ultrasound image, and the complexity of the feature. The intelligent detection system determines whether there is a determined key detection feature in all the features, specifically: when it is determined that the category of at least one feature of all the features included in the fetal ultrasound image is the determined category of the key detection feature, and/or, When it is determined that the position in the fetal ultrasound image of at least one of all the features included in the fetal ultrasound image is the determined key position (for example, the heart), and/or, when it is determined that at least one of all the features included in the fetal ultrasound image is located When the complexity level of a feature is greater than or equal to the determined complexity level threshold, it is determined that all features included in the fetal ultrasound image have at least one key detection feature. In this way, it can be determined that there are key detection features in all the features included in the fetal ultrasound image by various methods such as the type of the feature, the position of the fetus corresponding to the fetal ultrasound image and/or the complexity of the feature, etc., which can improve all the features included in the fetal ultrasound image. The determination efficiency and accuracy of key detection features exist in the graph, so as to improve the output accuracy and self-confidence rate of the corresponding cross-sectional schematic diagram, and thus facilitate the relevant personnel to intuitively know the key detection features.
该可选的实施例中,重点检测特征包括重要等级大于等于确定出的重要等级(例如:3级,等级越高,越重要)的特征和/或所在的标准切面内包含的结构特征的数量大于等于确定出的结构特征数量(例如:5个)的特征。In this optional embodiment, the key detection features include features whose importance level is greater than or equal to the determined importance level (for example, level 3, the higher the level, the more important) and/or the number of structural features contained in the standard section. Features greater than or equal to the number of structural features identified (for example: 5).
该可选的实施例中,重点检测特征可以包括重点结构特征和/或重点标准切面。进一步的,当输出标识从第一状态变为第二状态之后,可以保持该第二状态,这样可以清楚分辨该输出标识对应的结构特征是否被检测到,从而提高重点结构特征检测完毕的确定准确性,进而进一步提高胎儿生长发育情况的确定精准性。In this optional embodiment, the key detection features may include key structural features and/or key standard slices. Further, when the output flag changes from the first state to the second state, the second state can be maintained, so that it can be clearly distinguished whether the structural feature corresponding to the output flag is detected, thereby improving the accuracy of the detection of key structural features. sex, thereby further improving the accuracy of determining fetal growth and development.
该可选的实施例中,当判断出胎儿超声影像包括的所有特征不存在重点检测特征时,智能检测系统直接结束本次流程。In this optional embodiment, when it is determined that all the features included in the fetal ultrasound image do not have key detection features, the intelligent detection system directly ends this process.
可见,该可选的实施例通过判断胎儿超声影像包括的所有特征中是否 存在重点检测特征,若是,则输出重点检测特征对应的切面示意图,有利于清楚确定对应标准切面包括的所有结构特征被检测到,以及减少由于切面所包括的结构特征过多导致无法清楚确认该标准切面的所需检测的结构特征是否检测完毕的情况发生,以及便于相关人员知晓重要检测特征的特征检测情况,从而进一步有利于提高胎儿的生长发育情况的确定准确性。It can be seen that this optional embodiment determines whether there is a key detection feature in all the features included in the fetal ultrasound image, and if so, outputs a schematic diagram of the section corresponding to the key detection feature, which is conducive to clearly determining that all structural features included in the corresponding standard section are detected. and reduce the occurrence of the situation where it is impossible to clearly confirm whether the structural features required to be detected for the standard section have been detected due to too many structural features included in the section, and to facilitate the relevant personnel to know the feature detection of important detection features. It is beneficial to improve the accuracy of determining the growth and development of the fetus.
在另一个可选的实施例中,上述胎儿超声影像包括的所有特征包括胎儿超声影像的多个结构特征,每个特征的检测结果还包括该特征的特征参数,每个特征的特征参数包括该特征的类别信息。以及,在执行完毕步骤101之后,该胎儿超声影像的检测结果的输出控制方法还可以包括以下操作:In another optional embodiment, all the features included in the above-mentioned fetal ultrasound image include multiple structural features of the fetal ultrasound image, the detection result of each feature further includes a feature parameter of the feature, and the feature parameter of each feature includes the Class information for the feature. And, after performing step 101, the output control method of the detection result of the fetal ultrasound image may further include the following operations:
智能检测系统确定胎儿超声影像包括的每个结构特征所在帧胎儿超声图像的部位特征,并确定每个部位特征的特征参数,每个部位特征的特征参数包括该部位特征的类别信息;The intelligent detection system determines the part feature of the fetal ultrasound image in the frame where each structural feature included in the fetal ultrasound image is located, and determines the feature parameter of each part feature, and the feature parameter of each part feature includes the category information of the part feature;
智能检测系统根据每个特征的类别信息以及该特征对应的部位特征的类别信息,确定每个特征的标准切面,每个特征的检测结果还包括该特征的标准切面的检测结果。The intelligent detection system determines the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the detection result of the standard section of the feature.
可见,该可选的实施例通过根据结构特征的类别信息以及所在帧胎儿超声图像的部位特征的类别信息,确定结构特征的标准切面,能够提高胎儿的标准切面的确定准确性以及可靠性,从而进一步提高胎儿超声影像的检测结果的准确性以及可靠性。It can be seen that this optional embodiment can improve the accuracy and reliability of determining the standard section of the fetus by determining the standard section of the structural feature according to the category information of the structural feature and the category information of the part feature of the fetal ultrasound image in the frame, thereby improving the accuracy and reliability of the determination of the standard section of the fetus. Further improve the accuracy and reliability of the detection results of fetal ultrasound images.
在又一个可选的实施例中,在执行完毕步骤101之后,该胎儿超声影像的检测结果的输出控制方法还可以包括以下操作:In yet another optional embodiment, after step 101 is performed, the output control method for the detection result of the fetal ultrasound image may further include the following operations:
智能检测系统判断胎儿超声影像包括的所有特征中是否存在异常特征,当判断结果为是时,从胎儿超声影像包括的所有特征中筛选所有异常特征;The intelligent detection system judges whether there are abnormal features in all the features included in the fetal ultrasound image, and when the judgment result is yes, screen all the abnormal features from all the features included in the fetal ultrasound image;
智能检测系统按照确定出的排序方式对所有异常特征进行排序,得到排序后的所有异常特征,控制输出终端输出排序后的所有异常特征。The intelligent detection system sorts all abnormal features according to the determined sorting method, obtains all sorted abnormal features, and controls the output terminal to output all sorted abnormal features.
该可选的实施例中,异常特征可以包括异常结构特征和/或异常标准切面。In this optional embodiment, the abnormal features may include abnormal structural features and/or abnormal standard slices.
该可选的实施例中,确定出的排序方式包括按特征重要性、特征出现时长以及特征出现次数中的至少一种,其中,某一特征的特征重要性越高,表示胎儿超声影像对应的胎儿生长发育越异常;特征出现时长包括单次出现的持续时长或出现总次数的总时长。这样通过提高多种排序方式,能够提高异常特征的排序准确性,从而进一步提高相关人员清楚知晓胎儿的生长发育情况的准确性。In this optional embodiment, the determined sorting method includes at least one of feature importance, feature appearance duration, and feature appearance times, wherein, the higher the feature importance of a feature, the higher the feature importance of the fetal ultrasound image. The more abnormal the fetal growth and development; the duration of the characteristic appearance includes the duration of a single occurrence or the total duration of the total number of occurrences. In this way, by improving a variety of sorting methods, the sorting accuracy of abnormal features can be improved, thereby further improving the accuracy of the relevant personnel clearly knowing the growth and development of the fetus.
该可选的实施例中,当判断出胎儿超声影像的所有特征中存在确定出的与其正常特征不匹配的特征时,智能检测系统确定胎儿超声影像包括的所有特征中存在异常特征,且胎儿超声影像的异常特征包括与其正常特征不匹配的特征。In this optional embodiment, when it is determined that there is a determined feature that does not match its normal features among all the features of the fetal ultrasound image, the intelligent detection system determines that there are abnormal features in all the features included in the fetal ultrasound image, and the fetal ultrasound image has abnormal features. Abnormal features of an image include features that do not match their normal features.
在该可选的实施例中,智能检测系统判断胎儿超声影像包括的所有特征中是否存在异常特征,可以包括:In this optional embodiment, the intelligent detection system determines whether there are abnormal features in all the features included in the fetal ultrasound image, which may include:
当胎儿超声影像包括的所有特征为标准切面时,智能检测系统获取胎儿超声影像包括的每个标准切面的每个结构特征的信息,每个结构特征的信息用于确定该结构特征所在的标准切面是否为异常标准切面;When all the features included in the fetal ultrasound image are standard slices, the intelligent detection system acquires the information of each structural feature of each standard slice included in the fetal ultrasound image, and the information of each structural feature is used to determine the standard slice where the structural feature is located Whether it is an abnormal standard section;
智能检测系统根据每个标准切面的每个结构特征的信息,判断每个结构特征是否与所在的标准切面相匹配;According to the information of each structural feature of each standard section, the intelligent detection system judges whether each structural feature matches the standard section where it is located;
当判断出所有结构特征中存在与所在的标准切面不匹配的非匹配结构特征时,智能检测系统确定所有标准切面中存在结构特征为异常结构特征 的异常标准切面,且异常标准切面为非匹配结构特征所在的标准切面,即胎儿超声影像包括的所有特征中存在异常特征。When judging that there are non-matching structural features in all structural features that do not match the standard section, the intelligent detection system determines that there are abnormal standard sections whose structural features are abnormal structural features in all standard sections, and the abnormal standard section is a non-matching structure Abnormal features are present in the standard view on which the feature is located, that is, all features included in the fetal ultrasound image.
可见,该可选的实施例通过获取标准切面的每个结构特征的信息,并根据每个结构特征的信息判断每个结构特征是否与对应的标准切面匹配,能够实现胎儿超声影像存在异常特征的确定。It can be seen that in this optional embodiment, by acquiring information about each structural feature of the standard slice, and judging whether each structural feature matches the corresponding standard slice according to the information of each structural feature, it is possible to realize the detection of abnormal features in the fetal ultrasound image. Sure.
在另一个可选的实施例中,根据每个标准切面的每个结构特征的信息,判断每个结构特征是否与所在的标准切面相匹配,可以包括:In another optional embodiment, according to the information of each structural feature of each standard section, judging whether each structural feature matches the standard section where it is located may include:
根据每个标准切面的每个结构特征的信息,确定每个结构特征对应的表示类型,该表示类型包括数值表示类型和/或特征形态表示类型,每个结构特征的信息包括该结构特征的特征类别;According to the information of each structural feature of each standard section, determine the representation type corresponding to each structural feature, the representation type includes numerical representation type and/or feature morphological representation type, and the information of each structural feature includes the feature of the structural feature category;
当结构特征的表示类型为数值表示类型时,获取该结构特征对应的目标几何参数值,并判断该结构特征对应的目标几何参数值是否在预先确定出的正常参数值范围内,当判断结果否时,确定该结构特征与所在的标准切面不相匹配;When the representation type of the structural feature is a numerical representation type, obtain the target geometric parameter value corresponding to the structural feature, and judge whether the target geometric parameter value corresponding to the structural feature is within the predetermined normal parameter value range, and when the judgment result is no When , it is determined that the structural feature does not match the standard section where it is located;
当结构特征的表示类型为特征形态表示类型时,判断该结构特征是否位于该结构特征对应的部位特征的检测区域内,当判断出不在检测区域内时,确定该结构特征与所在的标准切面不相匹配。When the representation type of the structural feature is the feature morphological representation type, it is determined whether the structural feature is located in the detection area of the part feature corresponding to the structural feature. match.
该可选的实施例中,每个部位特征的检测区域可以用检测框,例如:多边形框或椭圆形框,框选出来。In this optional embodiment, the detection area of each part feature can be selected by a detection frame, such as a polygon frame or an oval frame.
该可选的实施例中,每个结构特征对应的目标几何参数值包括该结构特征对应的横径和/或该结构特征对应的周长,这样几何参数值包括的内容越多,越有利于提高结构特征与所在的标准切面相匹配的判断准确性。其中,不同结构特征均存在对应的正常参数值范围,其中,不同结构特征对应的正常参数值范围可以相同,也可以不同。进一步的,同一结构特征的不同几何参数值对应不同的正常参数值范围。又进一步的,每个结构特征对应的几何参数值可以包括比例尺寸和/或实际尺寸。具体的,在判断出结构特征对应的比例尺寸在预先确定出的正常参数值范围内之后,进一步获取结构特征对应的实际尺寸,并判断该实际尺寸是否在预先确定出的正常尺寸范围内,当判断结果否时,确定该结构特征与所在的标准切面不相匹配。这样通过同时将结构特征的比例尺寸以及实际尺寸与各自的正常值进行对比,能够提高结构特征与所在的标准切面是否相匹配的确定准确性,从而减少异常标准切面的切面分值的错误修正的情况发生,提高异常标准切面的切面分值的修正准确性以及可靠性。In this optional embodiment, the target geometric parameter value corresponding to each structural feature includes the transverse diameter corresponding to the structural feature and/or the perimeter corresponding to the structural feature, so that the more content the geometric parameter value includes, the more beneficial it is Improve the judgment accuracy that the structural features match the standard section where they are located. Wherein, different structural features have corresponding normal parameter value ranges, wherein the normal parameter value ranges corresponding to different structural features may be the same or different. Further, different geometric parameter values of the same structural feature correspond to different normal parameter value ranges. Still further, the geometric parameter values corresponding to each structural feature may include proportional dimensions and/or actual dimensions. Specifically, after judging that the proportional size corresponding to the structural feature is within the predetermined normal parameter value range, the actual size corresponding to the structural feature is further obtained, and it is judged whether the actual size is within the predetermined normal size range. When the judgment result is no, it is determined that the structural feature does not match the standard section where it is located. In this way, by simultaneously comparing the proportional size and actual size of the structural feature with their respective normal values, the accuracy of determining whether the structural feature matches the standard section where it is located can be improved, thereby reducing the error correction of the section score of the abnormal standard section. If the situation occurs, improve the accuracy and reliability of the correction of the section score of the abnormal standard section.
该可选的实施例中,在判断出结构特征位于该结构特征对应的部位特征的检测区域内时,判断是否多帧胎儿超声图像均存在该结构特征,当判断结果为是时,确定该结构特征与所在的标准切面不相匹配。其中,该多帧胎儿超声图像可以为以结构特征所在胎儿超声图像为首帧胎儿超声图像往后连续或者断续出现的胎儿超声图像。这样在判断出结构特征在对应部位特征的检测区域内时,进一步判断是否存在多帧胎儿超声图像存在该结构特征,若存在,则确定该结构特征与所在的标准切面不相匹配,能够提高结构特征与所在的标准切面是否相匹配的确定准确性,从而减少异常标准切面的切面分值的错误修正的情况发生,提高异常标准切面的切面分值的修正准确性以及可靠性。In this optional embodiment, when it is judged that the structural feature is located in the detection area of the part feature corresponding to the structural feature, it is judged whether the structural feature exists in all multiple frames of fetal ultrasound images, and when the judgment result is yes, the structural feature is determined The feature does not match the standard slice it is in. The multiple frames of fetal ultrasound images may be fetal ultrasound images that appear continuously or intermittently after the first frame of fetal ultrasound images with structural features as the first frame of fetal ultrasound images. In this way, when it is judged that the structural feature is in the detection area of the corresponding part feature, it is further judged whether there are multiple frames of fetal ultrasound images with the structural feature. The accuracy of determining whether the feature matches the standard slice where it is located can reduce the occurrence of incorrect correction of the slice score of the abnormal standard slice, and improve the accuracy and reliability of the correction of the slice score of the abnormal standard slice.
可见,该可选的实施例在判断出胎儿超声图像出现结构特征时,通过获取到的结构特征的几何参数值,判断结构特征与所在的标准切面是否相匹配,或者通过判断结构特征是否位于对应部位特征的检测区域内,来实 现结构特征与所在的标准切面是否相匹配的判断,能够提高结构特征与所在的标准切面是否相匹配的确定可能性、准确性以及确定效率。It can be seen that in this optional embodiment, when judging that the fetal ultrasound image has structural features, it can determine whether the structural features match the standard section where the structural features are located by using the obtained geometric parameter values of the structural features, or whether the structural features are located in the corresponding In the detection area of the part feature, to realize the judgment of whether the structural feature matches the standard section where it is located, it can improve the possibility, accuracy and efficiency of determining whether the structural feature matches the standard section where it is located.
该可选的实施例中,排序后的所有异常特征可以位于上述未检特征清单中,也可以位于上述已检特征清单中,还可以为所有异常特征新建一个异常特征清单,也即排序后的异常特征位于异常特征清单中。进一步的,无论是位于未检特征清单中,还是位于已检特征清单中,排序后的所有异常特征可以排序在对应清单中的前面位置。这样通过将异常特征置于清单中的前面位置,有利于相关人员更清楚且快速知晓胎儿超声影像的异常特征情况,从而进一步快速且清楚知晓胎儿的生长发育发生了异常情况。In this optional embodiment, all sorted abnormal features may be located in the aforementioned unchecked feature list, or may be located in the aforementioned checked feature list, and a new abnormal feature list may be created for all abnormal features, that is, the sorted feature list. Anomalous features are in the list of unusual features. Further, whether in the unchecked feature list or the checked feature list, all the sorted abnormal features can be sorted at the front position in the corresponding list. In this way, by placing the abnormal features at the front of the list, it is helpful for the relevant personnel to know the abnormal features of the fetal ultrasound images more clearly and quickly, so as to further quickly and clearly know that the abnormal growth and development of the fetus has occurred.
该可选的实施例中,当判断出胎儿超声影像包括的所有特征中不存在异常特征时,结束本次流程。In this optional embodiment, when it is determined that there is no abnormal feature among all the features included in the fetal ultrasound image, the process ends.
该可选的实施例中,步骤102中的检测结果还可以包括排序后的所有异常特征,即智能检测系统控制输出终端输出排序后的所有异常特征的动作可以和步骤102同时发生。In this optional embodiment, the detection result in step 102 may also include all sorted abnormal features, that is, the action of the intelligent detection system controlling the output terminal to output all sorted abnormal features may occur simultaneously with step 102 .
可见,该可选的实施例通过在检测到胎儿超声影像中的所有特征存在异常特征之后,进一步将所有异常特征进行排序,并输出排序后的异常特征,有利于相关人员快速知晓胎儿超声影像的异常特征情况,从而进一步快速且清楚知晓胎儿的生长发育发生了异常情况。It can be seen that, in this optional embodiment, after detecting that all the features in the fetal ultrasound image have abnormal features, all the abnormal features are further sorted, and the sorted abnormal features are output, which is helpful for the relevant personnel to quickly know the status of the fetal ultrasound image. Abnormal characteristics of the situation, so as to further quickly and clearly know that the growth and development of the fetus is abnormal.
在又一个可选的实施例中,该胎儿超声影像的检测结果的输出控制方法还可以包括以下操作:In yet another optional embodiment, the output control method for the detection result of the fetal ultrasound image may further include the following operations:
智能检测系统判断上述待检特征清单中的所有待检特征中是否存在检测完毕的特征,当判断结果为是时,控制输出终端向相关人员输出提示信息。The intelligent detection system judges whether all the features to be checked in the above-mentioned list of features to be checked have features that have been detected, and when the judgment result is yes, the output terminal is controlled to output prompt information to the relevant personnel.
该可选的实施例中,需要说明的是,也可以在待检特征清单中的所有待检特征均被检测完毕,才输出提示信息,该可选的实施例不做限定。In this optional embodiment, it should be noted that the prompt information may be output only after all the features to be checked in the feature list to be checked have been detected, which is not limited in this optional embodiment.
该可选的实施例中,提示信息的输出方式包括图文显示输出方式和/或语音输出方式(例如:“叮”一声,腹围切面检测完毕等),以及上述特征的检测结果包括提示信息。In this optional embodiment, the output mode of the prompt information includes a graphic display output mode and/or a voice output mode (for example, a "ding" sound, the detection of the abdominal girth section is completed, etc.), and the detection result of the above-mentioned features includes the prompt information .
可见,该可选的实施例通过在检测到待检特征检测完毕之后,自动向相关人员输出提示信息,无需相关人员实时监督哪些特征检测完成哪些没有检测,能够便于相关人员快速清楚且准确知晓特征的检测完成情况。It can be seen that this optional embodiment automatically outputs prompt information to the relevant personnel after the detection of the features to be inspected is completed, without the need for the relevant personnel to supervise in real time which features have been detected and which have not been detected, so that the relevant personnel can quickly, clearly and accurately know the features. completion of the detection.
可见,实施图1所描述的胎儿超声影像的检测结果的输出控制方法能够通过对胎儿超声影像进行自动分析,能够快速获取到准确的胎儿超声影像的每个特征(例如:结构特征、切面)的检测结果,例如:异常、正常、疑似、已检、未检,有利于实现准确确定胎儿的生长发育情况;以及通过对胎儿超声图像的每个特征进行标识,能够减少特征漏检的情况发生,以提高成功检测到所需检测特征的可能性,从而进一步有利于实现准确确定胎儿的生长发育情况。It can be seen that the output control method for the detection result of the fetal ultrasound image described in FIG. 1 can quickly obtain accurate information of each feature (eg, structural feature, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image. The detection results, such as: abnormal, normal, suspected, checked, and unchecked, help to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed feature detection, In order to improve the probability of successful detection of the desired detection features, it is further beneficial to accurately determine the growth and development of the fetus.
实施例二Embodiment 2
请参阅图2,图2是本发明实施例公开的另一种胎儿超声影像的检测结果的输出控制方法的流程示意图。其中,图2所描述的胎儿超声影像的检测结果的输出控制方法可以应用于智能检测系统(智能检测设备/智能检测服务器,其中,该智能检测服务器可以包括本地智能检测服务器或云智能检测服务器,本发明实施例不做限定)中。如图2所示,该胎儿超声影像的检测结果的输出控制方法可以包括以下操作:Please refer to FIG. 2 . FIG. 2 is a schematic flowchart of another method for controlling the output of detection results of fetal ultrasound images disclosed in an embodiment of the present invention. Wherein, the output control method of the detection result of the fetal ultrasound image described in FIG. 2 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server can include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited). As shown in FIG. 2 , the output control method of the detection result of the fetal ultrasound image may include the following operations:
201、智能检测系统将接收到的胎儿超声影像输入确定出的影像分析模 型中进行分析,并获取该影像分析模型输出的分析结果,作为该胎儿超声影像的检测结果。201. The intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image.
202、智能检测系统判断是否检测到针对某一目标特征类别对应的胎儿超声图像触发的回放请求。当判断结果为是时,触发执行步骤203;当判断结果为否时,可以结束本次流程,可以触发执行步骤205。202. The intelligent detection system determines whether a playback request triggered by a fetal ultrasound image corresponding to a certain target feature category is detected. When the judgment result is yes, the execution of step 203 is triggered; when the judgment result is no, the current process can be ended, and the execution of step 205 can be triggered.
本发明实施例中,回放请求用于请求回放目标特征类别对应的胎儿超声图像,且该目标特征类别对应的胎儿超声图像包括该目标特征类别对应的最优帧胎儿超声图像、该目标特征类别对应的所有标准切面的胎儿超声图像、该目标特征类别对应的所有章节的胎儿超声图像中的至少一种,上述胎儿超声影像包括目标特征类别对应的胎儿超声图像,每个章节包括的每个胎儿超声图像的标准切面的类别相同,目标特征类别包括目标结构特征类别和/或目标标准切面类别。In this embodiment of the present invention, the playback request is used to request playback of a fetal ultrasound image corresponding to a target feature category, and the fetal ultrasound image corresponding to the target feature category includes an optimal frame fetal ultrasound image corresponding to the target feature category, and the target feature category corresponds to the fetal ultrasound image. At least one of fetal ultrasound images of all standard slices of the target feature category, and fetal ultrasound images of all chapters corresponding to the target feature category, the above-mentioned fetal ultrasound images include fetal ultrasound images corresponding to the target feature category, and each fetal ultrasound image included in each chapter. The categories of the standard slices of the image are the same, and the target feature category includes the target structure feature category and/or the target standard section category.
本发明实施例中,目标特征类别的数量大于等于1,即可以一次性请求回放两种以上类型的胎儿超声图像,例如:腹围标准切面对应的最优帧胎儿超声图像以及丘脑标准切面对应的最优帧胎儿超声图像。In this embodiment of the present invention, if the number of target feature categories is greater than or equal to 1, it is possible to request playback of more than two types of fetal ultrasound images at one time, for example: the optimal frame fetal ultrasound image corresponding to the standard abdominal circumference view and the fetal ultrasound image corresponding to the standard view of the thalamus Optimal frame fetal ultrasound image.
本发明实施例中,当智能检测系统的拾音装置采集到针对目标特征类别的关键词(例如:腹围),确定检测到针对目标特征类别对应的胎儿超声图像触发的回放请求;当智能检测系统的显示装置接收到针对目标特征类别的关键词(例如:腹围),确定检测到针对目标特征类别对应的胎儿超声图像触发的回放请求;当智能检测系统接收到与该智能检测系统建立连接通信的终端设备(例如:计算机、手机)发送的针对目标特征类别的关键词(例如:腹围),确定检测到针对目标特征类别对应的胎儿超声图像触发的回放请求。进一步的,预先设置有多个特征类别对应的胎儿超声图像的回放请求姿势(例如:手势),此时,当智能检测系统的显示装置接收到针对目标特征类别的手势,确定检测到针对目标特征类别对应的胎儿超声图像触发的回放请求。这样通过提供多种针对结构特征和/或标准切面对应的胎儿超声图像回放的检测方式,能够提高结构特征和/或标准切面对应的胎儿超声图像回放请求的检测可能性,从而提高结构特征和/或标准切面对应的胎儿超声图像回放的概率。又进一步的,每个目标特征类别对应的最优帧胎儿超声图像、该目标特征类别对应的所有标准切面的胎儿超声图像、该目标特征类别对应的所有章节的胎儿超声图像的回放请求手势也均不相同,这样通过针对同一结构特征类别、标准切面类别不同的图像设置不同的回放请求手势,能够进一步提高结构特征和/或标准切面对应的胎儿超声图像回放准确性以及效率。In the embodiment of the present invention, when the sound pickup device of the intelligent detection system collects keywords (for example: abdominal circumference) for the target feature category, it is determined that a playback request triggered by the fetal ultrasound image corresponding to the target feature category is detected; when the intelligent detection The display device of the system receives the keyword (for example: abdominal circumference) for the target feature category, and determines that a playback request triggered by the fetal ultrasound image corresponding to the target feature category is detected; when the intelligent detection system receives and establishes a connection with the intelligent detection system The keyword (eg, abdominal circumference) for the target feature category sent by the communicating terminal device (eg, computer, mobile phone) determines that a playback request triggered by the fetal ultrasound image corresponding to the target feature category is detected. Further, a playback request posture (eg: gesture) of the fetal ultrasound image corresponding to a plurality of feature categories is preset. At this time, when the display device of the intelligent detection system receives the gesture for the target feature category, it is determined that the target feature is detected. The playback request triggered by the fetal ultrasound image corresponding to the category. In this way, by providing a variety of detection methods for the playback of fetal ultrasound images corresponding to structural features and/or standard slices, it is possible to improve the detection possibility of the request for playback of fetal ultrasound images corresponding to structural features and/or standard slices, thereby improving structural features and/or standard slices. Or the probability of playback of fetal ultrasound images corresponding to standard slices. Still further, the optimal frame fetal ultrasound images corresponding to each target feature category, the fetal ultrasound images of all standard slices corresponding to the target feature category, and the playback request gestures of the fetal ultrasound images of all chapters corresponding to the target feature category are also all displayed. In this way, by setting different playback request gestures for images of the same structural feature category and different standard slice categories, it is possible to further improve the playback accuracy and efficiency of fetal ultrasound images corresponding to structural features and/or standard slices.
203、智能检测系统根据回放请求确定目标特征类别对应的胎儿超声图像。203. The intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request.
204、智能检测系统控制输出终端回放目标特征类别对应的胎儿超声图像。204. The intelligent detection system controls the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
本发明实施例中,当目标特征类别对应的胎儿超声图像为该目标特征类别对应的所有标准切面的胎儿超声图像时,智能检测系统可以逐帧回放目标特征类别对应的所有标准切面的胎儿超声图像;当目标特征类别对应的胎儿超声图像为该目标特征类别对应的所有章节的胎儿超声图像时,智能检测系统可以逐章节回放目标特征类别对应的所有章节的胎儿超声图像。当目标特征类别对应的胎儿超声图像为该目标特征类别对应的最优帧胎儿超声图像时,智能检测系统可以直接回放目标特征类别对应的最优帧胎儿超声图像,也可以在逐帧或逐章节回放目标特征类别对应的胎儿超声图像 之后,智能检测系统回放目标特征类别对应的最优帧胎儿超声图像。这样通过逐帧或逐章节回放胎儿超声图像,有利于相关人员清楚通过胎儿超声图像清楚知晓胎儿的生长发育情况;以及通过通过直接回放最优帧胎儿超声图像或者通过在逐帧/逐章节回放胎儿超声图像之后再定位回放最优帧胎儿超声图像,在保证最优帧胎儿超声图像回放效率的同时,丰富了最优帧胎儿超声图像的回放方式。In the embodiment of the present invention, when the fetal ultrasound images corresponding to the target feature category are fetal ultrasound images of all standard slices corresponding to the target feature category, the intelligent detection system can play back fetal ultrasound images of all standard slices corresponding to the target feature category frame by frame ; When the fetal ultrasound images corresponding to the target feature category are fetal ultrasound images of all chapters corresponding to the target feature category, the intelligent detection system can play back the fetal ultrasound images of all chapters corresponding to the target feature category chapter by chapter. When the fetal ultrasound image corresponding to the target feature category is the optimal frame fetal ultrasound image corresponding to the target feature category, the intelligent detection system can directly play back the optimal frame fetal ultrasound image corresponding to the target feature category, or it can play frame by frame or chapter by chapter. After playing back the fetal ultrasound image corresponding to the target feature category, the intelligent detection system plays back the optimal frame fetal ultrasound image corresponding to the target feature category. In this way, by playing back the fetal ultrasound images frame by frame or chapter by chapter, it is helpful for the relevant personnel to clearly know the growth and development of the fetus through the fetal ultrasound images; After the ultrasound image, the optimal frame of fetal ultrasound image is positioned and played back, which enriches the playback mode of the optimal frame of fetal ultrasound image while ensuring the playback efficiency of the optimal frame of fetal ultrasound image.
可见,本发明实施例在获得胎儿超声影像的检测结果之后,进一步判断是否检测到针对某一目标特征类别的胎儿超声图像的回放请求,若检测到,控制输出终端回放目标特征类别的胎儿超声图像,能够便于相关人员重新回看胎儿超声图像,尤其当存胎儿超声影像对应的胎儿的生长发育存在异常情况时,通过回放胎儿超声图像有助于准确确定胎儿生长发育的异常情况。It can be seen that after obtaining the detection result of the fetal ultrasound image, the embodiment of the present invention further determines whether a playback request for a fetal ultrasound image of a certain target feature category is detected, and if detected, the output terminal is controlled to play back the fetal ultrasound image of the target feature category. , which can facilitate the relevant personnel to review the fetal ultrasound images, especially when the fetal growth and development corresponding to the fetal ultrasound images are abnormal, playback of the fetal ultrasound images helps to accurately determine the abnormal fetal growth and development.
205、智能检测系统控制与智能检测系统对应的输出终端输出检测结果。205. The intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the detection result.
需要说明的是,由于胎儿超声影像的检测结果是胎儿超声影像的实时分析结果或对胎儿超声影像分析完毕的分析结果(具体描述请参阅实施例一中的相关描述),则针对目标特征类别对应的胎儿超声图像触发的回放请求可以是实时触发的或对胎儿超声影像分析完毕时触发的,即目标特征类别对应的胎儿超声图像可以是实时的或者该目标特征类别在胎儿超声影像中的最终胎儿超声图像。It should be noted that, since the detection result of the fetal ultrasound image is the real-time analysis result of the fetal ultrasound image or the analysis result after the analysis of the fetal ultrasound image (for a specific description, please refer to the relevant description in Embodiment 1), the target feature category corresponds to The playback request triggered by the fetal ultrasound image can be triggered in real time or when the fetal ultrasound image analysis is completed, that is, the fetal ultrasound image corresponding to the target feature category can be real-time or the target feature category in the final fetal ultrasound image in the fetal ultrasound image. Ultrasound image.
进一步需要说明的是,步骤204可以和步骤205同时发生,即步骤205中的检测结果还可以包括某一目标特征类别对应的最优帧胎儿超声图像。又进一步需要说明的是,步骤202也可以发生在步骤205之后。当步骤202与步骤205同时发生时,步骤204发生在步骤205之后。It should be further noted that step 204 and step 205 may occur simultaneously, that is, the detection result in step 205 may also include the optimal frame fetal ultrasound image corresponding to a certain target feature category. It should be further noted that, step 202 may also occur after step 205 . When step 202 occurs at the same time as step 205, step 204 occurs after step 205.
本发明实施例中,针对步骤201以及步骤205的其他描述请参阅实施例一中针对步骤101-步骤102的详细描述,本发明实施例不再赘述。In this embodiment of the present invention, for other descriptions of step 201 and step 205, please refer to the detailed description of step 101 to step 102 in Embodiment 1, which is not repeated in this embodiment of the present invention.
作为一种可选的实施方式,智能检测系统根据回放请求确定所述目标特征类别对应的胎儿超声图像,包括:As an optional implementation manner, the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, including:
当目标特征类别对应的胎儿超声图像为目标特征类别对应的最优帧胎儿超声图像时,智能检测系统确定目标特征类别对应的所有标准切面中每个标准切面的切面分值,并根据该目标特征类别对应的所有标准切面中每个标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像。When the fetal ultrasound image corresponding to the target feature category is the optimal frame fetal ultrasound image corresponding to the target feature category, the intelligent detection system determines the section score of each standard section in all standard sections corresponding to the target feature category, and according to the target feature category The slice score of each standard slice in all standard slices corresponding to the category, and the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score is determined from all the standard slices as the optimal frame fetal ultrasound corresponding to the target feature category image.
该可选的实施方式中,进一步可选的,基于每个标准切面的每个结构特征对应的权重值以及该结构特征的特征参数,计算每个标准切面的切面分值,具体的:基于确定出的每个标准切面的每个结构特征对应的权重值、该结构特征的类别概率以及该结构特征的位置概率,计算每个标准切面的每个结构特征对应的结构分值;计算每个标准切面的所有结构特征对应的结构分值之和,作为该标准切面的切面分值。其中,每个标准切面对应一帧胎儿超声图像。其中,每个标准切面的每个结构特征对应的权重值用于表示该结构特征在该标准切面的表达等级,结构特征对应的权重值越高,其对应的表达等级越高,即结构特征在对应标准切面占的比重越高。In this optional embodiment, further optionally, based on the weight value corresponding to each structural feature of each standard cut plane and the characteristic parameter of the structural feature, the cut surface score of each standard cut surface is calculated, specifically: based on determining The weight value corresponding to each structural feature of each standard section, the category probability of the structural feature, and the position probability of the structural feature are calculated, and the structural score corresponding to each structural feature of each standard section is calculated; The sum of the structural scores corresponding to all the structural features of the section is taken as the section score of the standard section. Among them, each standard slice corresponds to a frame of fetal ultrasound image. The weight value corresponding to each structural feature of each standard section is used to represent the expression level of the structural feature in the standard section. The higher the weight value corresponding to the structural feature, the higher the corresponding expression level, that is, the structural feature is in The proportion of the corresponding standard section is higher.
该可选的实施方式中,每个标准切面的每个结构特征的特征参数包括该结构特征的类别概率以及该结构特征的位置概率。In this optional implementation manner, the feature parameter of each structural feature of each standard slice includes the class probability of the structural feature and the position probability of the structural feature.
该可选的实施方式中,每帧胎儿超声图像的标准切面的切面分值的计算公式如下:In this optional embodiment, the calculation formula of the slice score of the standard slice of each frame of fetal ultrasound image is as follows:
Figure PCTCN2021096816-appb-000001
Figure PCTCN2021096816-appb-000001
H i=P i×Q i×O iH i =P i ×Q i ×O i ;
Figure PCTCN2021096816-appb-000002
Figure PCTCN2021096816-appb-000002
式中,S为每个标准切面的切面分值,H i为每个标准切面中第i个结构特征的结构分值,M为每个标准切面中结构特征的总数量,P i为每个标准切面中第i个结构特征的类别概率(又称置信度),Q i为每个标准切面中第i个结构特征的位置概率,O i为每个标准切面中第i个结构特征的权重值,N为第i个结构特征的关键权重值影响因子的总数量,O ij为每个标准切面中第i个结构特征中第j个关键权重值影响因子对应的子权重值。 In the formula, S is the section score of each standard section, H i is the structural score of the i-th structural feature in each standard section, M is the total number of structural features in each standard section, and P i is each The class probability (also known as confidence) of the ith structural feature in the standard section, Q i is the position probability of the ith structural feature in each standard section, O i is the weight of the ith structural feature in each standard section value, N is the total number of key weight value influencing factors of the ith structural feature, O ij is the sub-weight value corresponding to the jth key weight value influencing factor in the ith structural feature in each standard section.
该可选的实施方式中,进一步的,每个标准切面内结构特征包括的参数还包括该结构特征所在的部位的概率,此时,每个标准切面中第i个结构特征的结构分值的计算公式为:In this optional embodiment, further, the parameters included in the structural feature in each standard section also include the probability of the position where the structural feature is located. In this case, the structural score of the i-th structural feature in each standard section is The calculation formula is:
H i=P i×Q i×O i×C iH i =P i ×Q i ×O i ×C i ;
式中,C i为每个标准切面内结构特征包括的参数还包括该结构特征所在的部位的概率。这样结构特征的参数越多,有利于提高结构特征的结构分值的计算准确性,从而提高标准切面的切面分值的计算准确性,进而有利于提高最优标准切面的确定精准性以及可靠性。 In the formula, C i is the parameter included in the structural feature in each standard section, and also includes the probability of the position where the structural feature is located. In this way, the more parameters of the structural feature, the more accurate the calculation of the structural score of the structural feature will be, the more accurate the calculation of the sectional score of the standard section will be, and the more accurate and reliable the determination of the optimal standard section will be. .
这样通过分别计算标准切面的每个结构特征对应的结构分值,能够实现标准切面的切面分值的计算,有利于提高标准切面的切面分值计算精准性以及效率;以及根据不同的结构特征,选取不同的参数,能够提高结构特征对应的结构分值的计算精准性以及效率,从而进一步提高标准切面的切面分值计算精准性以及效率。In this way, by separately calculating the structural score corresponding to each structural feature of the standard cut surface, the calculation of the cut surface score of the standard cut surface can be realized, which is beneficial to improve the accuracy and efficiency of the calculation of the cut surface score of the standard cut surface; and according to different structural characteristics, Selecting different parameters can improve the calculation accuracy and efficiency of the structural score corresponding to the structural feature, thereby further improving the calculation accuracy and efficiency of the section score of the standard section.
可见,该可选的实施方式通过将最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为最优帧胎儿超声图像,能够提高最优帧胎儿超声图像的确定准确性以及效率,从而提高最优帧胎儿超声图像的输出准确性以及效率。It can be seen that this optional embodiment can improve the accuracy and efficiency of determining the optimal frame fetal ultrasound image by using the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score as the optimal frame fetal ultrasound image, thereby improving the accuracy and efficiency of determining the optimal frame fetal ultrasound image. Improve the output accuracy and efficiency of optimal frame fetal ultrasound images.
在一个可选的实施例中,智能检测系统根据目标特征类别对应的所有标准切面中每个标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像之前,该胎儿超声影像的检测结果的输出控制方法还可以包括以下操作:In an optional embodiment, the intelligent detection system determines the frame corresponding to the standard slice corresponding to the highest slice score from all the standard slices according to the slice score of each standard slice in all standard slices corresponding to the target feature category Before taking the fetal ultrasound image as the optimal frame fetal ultrasound image corresponding to the target feature category, the output control method for the detection result of the fetal ultrasound image may further include the following operations:
当目标特征类别为目标结构特征类别时,智能检测系统判断目标特征类别是否对应至少两个匹配特征类别,至少两个匹配特征类别包括至少两个匹配标准切面类别或至少两个匹配章节类别;When the target feature category is the target structure feature category, the intelligent detection system determines whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include at least two matching standard section categories or at least two matching chapter categories;
当判断结果为否时,智能检测系统触发执行上述的根据目标特征类别对应的所有标准切面中每个标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像的操作;When the judgment result is no, the intelligent detection system triggers the execution of the above-mentioned slice score of each standard slice in all standard slices corresponding to the target feature category, and determines the standard slice corresponding to the highest slice score from all the standard slices. The frame fetal ultrasound image is used as the operation of the optimal frame fetal ultrasound image corresponding to the target feature category;
当判断结果为是时,智能检测系统确定目标特征类别对应的每个匹配特征类别对应的所有标准切面中每个标准切面的切面分值,并根据每个匹配特征类别对应的每个标准切面的切面分值,从所有该标准切面中筛选最高切面分值对应的帧胎儿超声图像,以及确定所有匹配特征类别对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像,该目标特征类别对应的最优帧胎儿超声图像的数量大于1。When the judgment result is yes, the intelligent detection system determines the section score of each standard section in all standard sections corresponding to each matching feature category corresponding to the target feature category, and determines the section score of each standard section corresponding to each matching feature category according to the score of each standard section corresponding to each matching feature category Slice score, screen the fetal ultrasound image frame corresponding to the highest slice score from all the standard slices, and determine the fetal ultrasound image frame corresponding to all matching feature categories as the optimal frame fetal ultrasound image corresponding to the target feature category. The number of optimal frame fetal ultrasound images corresponding to the feature category is greater than one.
举例来说,需要确定胃泡结构特征对应的最优帧胎儿超声图像,由于胃泡结构特征对应的标准切面包括腹围标准切面以及胆囊脐静脉切面,则胃泡结构特征对应的最优帧胎儿超声图像包括腹围标准切面对应的最优帧胎儿超声图像以及胆囊脐静脉切面对应的最优帧胎儿超声图像,也即胃泡结构特征对应的最优帧胎儿超声图像的数量为2。For example, it is necessary to determine the optimal frame of fetal ultrasound images corresponding to the structural features of gastric vesicles. Since the standard slices corresponding to the structural characteristics of gastric vesicles include standard abdominal girth slices and gallbladder-umbilical vein slices, the optimal frame of fetal ultrasound images corresponding to the structural characteristics of gastric vesicles is required. The ultrasound images include the optimal frame fetal ultrasound image corresponding to the standard abdominal girth section and the optimal frame fetal ultrasound image corresponding to the gallbladder-umbilical vein section, that is, the number of optimal frame fetal ultrasound images corresponding to the structural features of the gastric bubble is 2.
可见,该可选的实施例通过先判断结构特征对应的标准切面类别和/或章节类别的数量是否有多个,若否,则直接确定该结构特征对应的最优帧胎儿超声图像,这样能够提高结构特征对应的最优帧胎儿超声图像的确定效率以及准确性;若是,则分别确定不同标准切面类别和/或章节类别对应的最优帧胎儿超声图像,从而进一步提高最优帧胎儿超声图像的确定准确性。It can be seen that this optional embodiment first determines whether there are multiple standard slice categories and/or chapter categories corresponding to the structural feature, and if not, directly determines the optimal frame fetal ultrasound image corresponding to the structural feature, which can Improve the efficiency and accuracy of determining the optimal frame fetal ultrasound image corresponding to the structural feature; if so, determine the optimal frame fetal ultrasound image corresponding to different standard slice categories and/or chapter categories, thereby further improving the optimal frame fetal ultrasound image. accuracy of determination.
可见,实施图2所描述的胎儿超声影像的检测结果的输出控制方法能够通过对胎儿超声影像进行自动分析,能够快速获取到准确的胎儿超声影像的每个特征(例如:结构特征、切面)的检测结果,例如:异常、正常、疑似、已检、未检,有利于实现准确确定胎儿的生长发育情况;以及通过对胎儿超声图像的每个特征进行标识,能够减少特征漏检的情况发生,以提高成功检测到所需检测特征的可能性,从而进一步有利于实现准确确定胎儿的生长发育情况。It can be seen that, implementing the output control method for the detection result of the fetal ultrasound image described in FIG. 2 can quickly obtain accurate information of each feature (eg, structural feature, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image. The detection results, such as: abnormal, normal, suspected, checked, and unchecked, help to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed feature detection, In order to improve the probability of successful detection of the desired detection features, it is further beneficial to accurately determine the growth and development of the fetus.
实施例三Embodiment 3
请参阅图3,图3是本发明实施例公开的一种胎儿超声影像的检测结果的输出控制装置的结构示意图。其中,图3所描述的胎儿超声影像的检测结果的输出控制装置可以应用于智能检测系统(智能检测设备/智能检测服务器,其中,该智能检测服务器可以包括本地智能检测服务器或云智能检测服务器,本发明实施例不做限定)中。如图3所示,该胎儿超声影像的检测结果的输出控制装置可以包括分析模块301、获取模块302以及控制模块303,其中:Please refer to FIG. 3 . FIG. 3 is a schematic structural diagram of a device for outputting a detection result of a fetal ultrasound image according to an embodiment of the present invention. Wherein, the output control device of the detection result of the fetal ultrasound image described in FIG. 3 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server can include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited). As shown in FIG. 3 , the output control device for the detection result of the fetal ultrasound image may include an analysis module 301, an acquisition module 302 and a control module 303, wherein:
分析模块301,用于将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析。The analysis module 301 is configured to input the received fetal ultrasound image into the determined image analysis model for analysis.
获取模块302,用于获取影像分析模型输出的分析结果,作为胎儿超声影像的检测结果。The obtaining module 302 is configured to obtain the analysis result output by the image analysis model as the detection result of the fetal ultrasound image.
控制模块303,用于控制与智能检测系统对应的输出终端输出检测结果。The control module 303 is configured to control the output terminal corresponding to the intelligent detection system to output the detection result.
本发明实施例中,胎儿超声影像的检测结果包括胎儿超声影像的多个特征的检测结果,每个特征的检测结果包括该特征的检测标识,每个特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种,已检且疑似特征为被检测到且不确定类别的特征,已检且异常特征为已经被检测且存在异常结构特征的特征。In this embodiment of the present invention, the detection result of the fetal ultrasound image includes the detection result of multiple features of the fetal ultrasound image, the detection result of each feature includes the detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of the features to be checked, checked and normal features, checked and suspected features, and checked and abnormal features. The checked and suspected features are features that have been detected and are of uncertain category, and the checked and abnormal features are features that have been detected. Features that are detected and present with abnormal structural features.
本发明实施例中,进一步可选的,输出终端的输出界面包括第一区域和第二区域,第一区域用于输出检测结果,第二区域用于输出胎儿超声影像对应的待检特征清单和已检特征清单,待检特征清单用于存储确定出的胎儿超声图像的多个待检特征,已检特征清单用于存储胎儿超声图像的多个已检特征,且待检特征清单所包括的所有待检特征的类别包括已检特征清单所包括的所有已检特征的类别,胎儿超声影像包括的多个特征的类别包括待检特征清单所包括的所有待检特征的类别。In the embodiment of the present invention, further optionally, the output interface of the output terminal includes a first area and a second area, the first area is used for outputting detection results, and the second area is used for outputting a list of features to be checked corresponding to the fetal ultrasound image and a second area. Checked feature list, to-be-checked feature list is used to store a plurality of unchecked features of the determined fetal ultrasound image, checked feature list is used to store multiple checked features of the fetal ultrasound image, and the to-be-checked feature list includes The categories of all features to be checked include the categories of all features to be checked included in the checked feature list, and the categories of multiple features included in the fetal ultrasound image include the categories of all features to be checked included in the feature list to be checked.
可见,实施图3所描述的胎儿超声影像的检测结果的输出控制装置能够通过对胎儿超声影像进行自动分析,能够快速获取到准确的胎儿超声影 像的每个特征(例如:结构特征、切面)的检测结果,例如:异常、正常、疑似、已检、未检,有利于实现准确确定胎儿的生长发育情况;以及通过对胎儿超声图像的每个特征进行标识,能够减少特征漏检的情况发生,以提高成功检测到所需检测特征的可能性,从而进一步有利于实现准确确定胎儿的生长发育情况。It can be seen that the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 3 can quickly obtain accurate information of each feature (eg, structural feature, section) of the fetal ultrasound image by automatically analyzing the fetal ultrasound image. The detection results, such as: abnormal, normal, suspected, checked, and unchecked, help to accurately determine the growth and development of the fetus; and by identifying each feature of the fetal ultrasound image, it can reduce the occurrence of missed feature detection, In order to improve the probability of successful detection of the desired detection features, it is further beneficial to accurately determine the growth and development of the fetus.
在一个可选的实施例中,如图4所示,该装置还包括第一判断模块304以及第一确定模块305,其中:In an optional embodiment, as shown in FIG. 4 , the apparatus further includes a first determination module 304 and a first determination module 305, wherein:
第一判断模块304,用于根据胎儿超声影像包括的所有特征的目标信息,判断所有特征中是否存在确定出的重点检测特征。The first judging module 304 is configured to judge, according to the target information of all the features included in the fetal ultrasound image, whether there is a determined key detection feature in all the features.
控制模块303,还用于当第一判断模块304判断出胎儿超声影像包括的所有特征存在至少一个重点检测特征时,控制输出终端输出与每个重点检测特征对应的切面示意图,每个重点检测特征对应的切面示意图包括该重点检测特征对应的标准切面中每个结构特征的输出标识。The control module 303 is further configured to control the output terminal to output a schematic section diagram corresponding to each key detection feature when the first determination module 304 determines that all the features included in the fetal ultrasound image have at least one key detection feature, and each key detection feature The corresponding section schematic diagram includes the output identification of each structural feature in the standard section corresponding to the key detection feature.
第一确定模块305,用于根据每个重点检测特征对应的切面示意图包括的每个输出标识的变化情况确定该输出标识对应的结构特征的检测情况。The first determination module 305 is configured to determine the detection status of the structural feature corresponding to the output marker according to the change of each output marker included in the schematic sectional view corresponding to each key detection feature.
其中,对于任一重点检测特征,当重点检测特征对应的切面示意图包括的每个输出标识的变化情况用于表示该输出标识从第一状态变为第二状态时,每个输出标识对应的结构特征的检测情况用于表示该结构特征在对应的标准切面中被检测到。Wherein, for any key detection feature, when the change of each output flag included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output flag changes from the first state to the second state, the structure corresponding to each output flag The detection status of the feature is used to indicate that the structural feature is detected in the corresponding standard section.
可见,实施图4所描述的胎儿超声影像的检测结果的输出控制装置通过判断胎儿超声影像包括的所有特征中是否存在重点检测特征,若是,则输出重点检测特征对应的切面示意图,有利于清楚确定对应标准切面包括的所有结构特征被检测到,以及减少由于切面所包括的结构特征过多导致无法清楚确认该标准切面的所需检测的结构特征是否检测完毕的情况发生,以及便于相关人员知晓重要检测特征的特征检测情况,从而进一步有利于提高胎儿的生长发育情况的确定准确性。It can be seen that the output control device implementing the detection result of the fetal ultrasound image described in FIG. 4 determines whether there is a key detection feature in all the features included in the fetal ultrasound image, and if so, outputs a schematic diagram of the section corresponding to the key detection feature, which is conducive to clear determination. All structural features included in the corresponding standard section are detected, and the occurrence of the situation where it is impossible to clearly confirm whether the structural features required to be detected in the standard section due to too many structural features included in the section is reduced, and it is convenient for the relevant personnel to know the important The feature detection situation of the detection feature is further beneficial to improve the accuracy of determining the growth and development situation of the fetus.
在另一个可选的实施例中,上述胎儿超声影像包括的所有特征包括胎儿超声影像的多个结构特征,每个特征的检测结果还包括该特征的特征参数,每个特征的特征参数包括该特征的类别信息。以及如图4所示,该装置还包括第二确定模块306,其中:In another optional embodiment, all the features included in the above-mentioned fetal ultrasound image include multiple structural features of the fetal ultrasound image, the detection result of each feature further includes a feature parameter of the feature, and the feature parameter of each feature includes the Class information for the feature. And as shown in FIG. 4 , the apparatus further includes a second determination module 306, wherein:
获取模块302,还用于在获取影像分析模型输出的分析结果,作为胎儿超声影像的检测结果之后,确定胎儿超声影像包括的每个结构特征所在帧胎儿超声图像的部位特征。The obtaining module 302 is further configured to, after obtaining the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine the part feature of the fetal ultrasound image of the frame where each structural feature included in the fetal ultrasound image is located.
第二确定模块306,用于确定每个部位特征的特征参数,每个部位特征的特征参数包括该部位特征的类别信息。The second determination module 306 is configured to determine a feature parameter of each part feature, where the feature parameter of each part feature includes category information of the part feature.
第二确定模块306,还用于根据每个特征的类别信息以及该特征对应的部位特征的类别信息,确定每个特征的标准切面,每个特征的检测结果还包括该特征的标准切面的检测结果。The second determination module 306 is further configured to determine the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the detection of the standard section of the feature result.
可见,实施图4所描述的胎儿超声影像的检测结果的输出控制装置通过根据结构特征的类别信息以及所在帧胎儿超声图像的部位特征的类别信息,确定结构特征的标准切面,能够提高胎儿的标准切面的确定准确性以及可靠性,从而进一步提高胎儿超声影像的检测结果的准确性以及可靠性。It can be seen that the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 can improve the standard of the fetus by determining the standard section of the structural feature according to the category information of the structural feature and the category information of the part feature of the fetal ultrasound image in the frame. The accuracy and reliability of the determination of the slice are further improved, thereby further improving the accuracy and reliability of the detection results of fetal ultrasound images.
在又一个可选的实施例中,如图5所示,该装置还可以包括第二判断模块307以及第三确定模块308,其中:In yet another optional embodiment, as shown in FIG. 5 , the apparatus may further include a second determination module 307 and a third determination module 308, wherein:
第二判断模块307,用于在获取模块302获取影像分析模型输出的分析结果,作为胎儿超声影像的检测结果之后,判断是否检测到针对某一目标 特征类别对应的胎儿超声图像触发的回放请求,该回放请求用于请求回放目标特征类别对应的胎儿超声图像,且该目标特征类别对应的胎儿超声图像包括目标特征类别对应的最优帧胎儿超声图像、目标特征类别对应的所有标准切面的胎儿超声图像、目标特征类别对应的所有章节的胎儿超声图像中的至少一种,胎儿超声影像包括目标特征类别对应的胎儿超声图像,目标特征类别包括目标结构特征类别和/或目标标准切面类别,每个章节包括的每个胎儿超声图像的标准切面的类别相同。The second judgment module 307 is configured to, after the acquisition module 302 acquires the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine whether a playback request triggered by the fetal ultrasound image corresponding to a certain target feature category is detected, The playback request is used to request playback of a fetal ultrasound image corresponding to a target feature category, and the fetal ultrasound image corresponding to the target feature category includes the optimal frame fetal ultrasound image corresponding to the target feature category, and fetal ultrasound images of all standard slices corresponding to the target feature category Image, at least one of the fetal ultrasound images of all chapters corresponding to the target feature category, the fetal ultrasound image includes the fetal ultrasound image corresponding to the target feature category, the target feature category includes the target structural feature category and/or the target standard slice category, each The chapters include the same categories of standard views for each fetal ultrasound image.
第三确定模块308,用于当第二判断模块307判断结果为是时,根据回放请求确定目标特征类别对应的胎儿超声图像。The third determination module 308 is configured to determine the fetal ultrasound image corresponding to the target feature category according to the playback request when the determination result of the second determination module 307 is yes.
控制模块303,还用于控制输出终端回放目标特征类别对应的胎儿超声图像。The control module 303 is further configured to control the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
可见,实施图4所描述的胎儿超声影像的检测结果的输出控制装置在获得胎儿超声影像的检测结果之后,进一步判断是否检测到针对某一目标特征类别的胎儿超声图像的回放请求,若检测到,控制输出终端回放目标特征类别的胎儿超声图像,能够便于相关人员重新回看胎儿超声图像,尤其当存胎儿超声影像对应的胎儿的生长发育存在异常情况时,通过回放胎儿超声图像有助于准确确定胎儿生长发育的异常情况。It can be seen that the output control device implementing the detection result of the fetal ultrasound image described in FIG. 4 further determines whether a playback request for a fetal ultrasound image of a certain target feature category is detected after obtaining the detection result of the fetal ultrasound image. , control the output terminal to play back the fetal ultrasound images of the target feature category, which can facilitate the relevant personnel to review the fetal ultrasound images, especially when the fetal growth and development corresponding to the stored fetal ultrasound images are abnormal. Identify abnormalities in fetal growth and development.
在又一个可选的实施例中,如图4所示,第三确定模块308可以包括确定子模块3081,其中:In yet another optional embodiment, as shown in FIG. 4 , the third determination module 308 may include a determination sub-module 3081, wherein:
确定子模块3081,用于当目标特征类别对应的胎儿超声图像为目标特征类别对应的最优帧胎儿超声图像时,确定目标特征类别对应的所有标准切面中每个标准切面的切面分值。The determining submodule 3081 is configured to determine the slice score of each standard slice in all standard slices corresponding to the target characteristic type when the fetal ultrasound image corresponding to the target characteristic type is the optimal frame fetal ultrasonic image corresponding to the target characteristic type.
确定子模块3081,还用于根据所标特征类别对应的所有标准切面中每个标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像。The determination sub-module 3081 is further configured to determine, from all the standard slices, the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score according to the slice score of each standard slice in all standard slices corresponding to the marked feature category , as the optimal frame fetal ultrasound image corresponding to the target feature category.
可见,实施图4所描述的胎儿超声影像的检测结果的输出控制装置通过将最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为最优帧胎儿超声图像,能够提高最优帧胎儿超声图像的确定准确性以及效率,从而提高最优帧胎儿超声图像的输出准确性以及效率。It can be seen that the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 can improve the optimal frame fetal ultrasound image by using the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score as the optimal frame fetal ultrasound image. Accuracy and efficiency of ultrasound image determination, thereby improving the output accuracy and efficiency of optimal frame fetal ultrasound images.
在又一个可选的实施例中,如图4所示,第三确定模块308还包括判断子模块3082以及筛选子模块3083,其中:In yet another optional embodiment, as shown in FIG. 4 , the third determining module 308 further includes a judging sub-module 3082 and a screening sub-module 3083, wherein:
判断子模块3082,用于在确定子模块3081根据目标特征类别对应的所有标准切面中每个标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像之前,且当目标特征类别为目标结构特征类别时,判断目标特征类别是否对应至少两个匹配特征类别,至少两个匹配特征类别包括至少两个匹配标准切面类别或至少两个匹配章节类别;当判断结果为否时,触发确定子模块3081执行上述的根据目标特征类别对应的所有标准切面中每个标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像的操作。The judging submodule 3082 is used to determine the frame corresponding to the standard section corresponding to the highest section score from all the standard sections according to the section score of each standard section in all the standard sections corresponding to the target feature category in the determining submodule 3081 The fetal ultrasound image, before the optimal frame fetal ultrasound image corresponding to the target feature category, and when the target feature category is the target structural feature category, determine whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include At least two matching standard section categories or at least two matching chapter categories; when the judgment result is no, trigger the determination sub-module 3081 to execute the above-mentioned section score of each standard section in all standard sections corresponding to the target feature category, from The operation of determining the frame of fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score among all the standard slices as the optimal frame of fetal ultrasound image corresponding to the target feature category.
确定子模块3081,还用于当判断子模块3082判断结果为是时,确定目标特征类别对应的每个匹配特征类别对应的所有标准切面中每个标准切面的切面分值。The determination sub-module 3081 is further configured to determine the slice score of each standard slice in all standard slices corresponding to each matching feature category corresponding to the target feature category when the determination result of the determination sub-module 3082 is yes.
筛选子模块3083,用于根据每个匹配特征类别对应的每个标准切面的 切面分值,从所有该标准切面中筛选最高切面分值对应的帧胎儿超声图像; Screening submodule 3083, for screening the fetal ultrasound image of the frame corresponding to the highest slice score from all the standard slices according to the slice score of each standard slice corresponding to each matching feature category;
确定子模块3081,还用于确定所有匹配特征类别对应的帧胎儿超声图像,作为目标特征类别对应的最优帧胎儿超声图像,该目标特征类别对应的最优帧胎儿超声图像的数量大于1。The determination sub-module 3081 is further configured to determine the frames of fetal ultrasound images corresponding to all matching feature categories as the optimal frame fetal ultrasound images corresponding to the target feature category, and the number of optimal frame fetal ultrasound images corresponding to the target feature category is greater than 1.
可见,实施图4所描述的胎儿超声影像的检测结果的输出控制装置通过先判断结构特征对应的标准切面类别和/或章节类别的数量是否有多个,若否,则直接确定该结构特征对应的最优帧胎儿超声图像,这样能够提高结构特征对应的最优帧胎儿超声图像的确定效率以及准确性;若是,则分别确定不同标准切面类别和/或章节类别对应的最优帧胎儿超声图像,从而进一步提高最优帧胎儿超声图像的确定准确性。It can be seen that the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 first determines whether there are multiple standard slice categories and/or chapter categories corresponding to the structural feature, and if not, directly determines that the structural feature corresponds to The optimal frame fetal ultrasound image can improve the efficiency and accuracy of determining the optimal frame fetal ultrasound image corresponding to the structural features; if so, determine the optimal frame fetal ultrasound image corresponding to different standard slice categories and/or chapter categories respectively. , thereby further improving the accuracy of determining the optimal frame fetal ultrasound image.
在又一个可选的实施例中,如图4所示,该装置还包括第三判断模块309、筛选模块310以及排序模块311,其中:In yet another optional embodiment, as shown in FIG. 4 , the apparatus further includes a third judging module 309, a screening module 310 and a sorting module 311, wherein:
第三判断模块309,用于在获取模块302获取影像分析模型输出的分析结果,作为胎儿超声影像的检测结果之后,判断胎儿超声影像包括的所有特征中是否存在异常特征。The third judging module 309 is configured to, after the obtaining module 302 obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, determine whether there is any abnormal feature in all the features included in the fetal ultrasound image.
筛选模块310,用于当第三判断模块309判断结果为是时,从胎儿超声影像包括的所有特征中筛选所有异常特征。The screening module 310 is configured to screen all abnormal features from all features included in the fetal ultrasound image when the third determination module 309 determines that the result is yes.
排序模块311,用于按照确定出的排序方式对所有异常特征进行排序,得到排序后的所有异常特征。The sorting module 311 is configured to sort all abnormal features according to the determined sorting method, and obtain all sorted abnormal features.
控制模块303,用于控制输出终端输出排序后的所有异常特征。The control module 303 is configured to control the output terminal to output all sorted abnormal features.
可见,实施图4所描述的胎儿超声影像的检测结果的输出控制装置通过在检测到胎儿超声影像中的所有特征存在异常特征之后,进一步将所有异常特征进行排序,并输出排序后的异常特征,有利于相关人员快速知晓胎儿超声影像的异常特征情况,从而进一步快速且清楚知晓胎儿的生长发育发生了异常情况。It can be seen that the output control device for implementing the detection result of the fetal ultrasound image described in FIG. 4 further sorts all the abnormal features after detecting that all the features in the fetal ultrasound image have abnormal features, and outputs the sorted abnormal features, It is helpful for relevant personnel to quickly know the abnormal characteristics of fetal ultrasound images, so as to further quickly and clearly know the abnormal situation of fetal growth and development.
实施例四Embodiment 4
请参阅图5,图5是本发明实施例公开的又一种胎儿超声影像的检测结果的输出控制装置。其中,图5所描述的胎儿超声影像的检测结果的输出控制装置可以应用于智能检测系统(智能检测设备/智能检测服务器,其中,该智能检测服务器可以包括本地智能检测服务器或云智能检测服务器,本发明实施例不做限定)中。如图5所示,该胎儿超声影像的检测结果的输出控制装置可以包括:Please refer to FIG. 5 . FIG. 5 is another apparatus for outputting a detection result of a fetal ultrasound image disclosed in an embodiment of the present invention. Wherein, the output control device of the detection result of the fetal ultrasound image described in FIG. 5 can be applied to an intelligent detection system (intelligent detection device/intelligent detection server, wherein the intelligent detection server may include a local intelligent detection server or a cloud intelligent detection server, The embodiments of the present invention are not limited). As shown in FIG. 5 , the output control device for the detection result of the fetal ultrasound image may include:
存储有可执行程序代码的存储器501;a memory 501 storing executable program code;
与存储器501耦合的处理器502;a processor 502 coupled to the memory 501;
进一步的,还可以包括与处理器502耦合的输入接口503以及输出接口504;Further, it may also include an input interface 503 coupled with the processor 502 and an output interface 504;
其中,处理器502调用存储器501中存储的可执行程序代码,用于执行实施例一或实施例二所描述的胎儿超声影像的检测结果的输出控制方法中部分或者全部的步骤。The processor 502 invokes the executable program code stored in the memory 501 to execute some or all of the steps in the output control method for the detection result of the fetal ultrasound image described in the first embodiment or the second embodiment.
实施例五Embodiment 5
请参阅图6,图6是本发明实施例公开的一种智能检测系统的结构示意图。如图6所示,该智能检测系统可以包括胎儿超声影像的检测结果的输出控制装置,且用于实现图1或图2实施例所描述的胎儿超声影像的检测结果的输出控制方法。可选的,胎儿超声影像的检测结果的输出控制装置可以为图3或图4任一项所描述的胎儿超声影像的检测结果的输出控制装置,本发明实施例不做限定。Please refer to FIG. 6, which is a schematic structural diagram of an intelligent detection system disclosed in an embodiment of the present invention. As shown in FIG. 6 , the intelligent detection system may include an output control device for the detection result of the fetal ultrasound image, and is used to implement the output control method for the detection result of the fetal ultrasound image described in the embodiment of FIG. 1 or FIG. 2 . Optionally, the output control device for the detection result of the fetal ultrasound image may be the output control device for the detection result of the fetal ultrasound image described in any one of FIG. 3 or FIG. 4 , which is not limited in the embodiment of the present invention.
实施例六Embodiment 6
本发明实施例公开了一种计算机可读存储介质,其存储用于电子数据交换的计算机程序,其中,该计算机程序使得计算机执行实施例一或实施例二所描述的胎儿超声影像的检测结果的输出控制方法中部分或者全部的步骤。An embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute the detection result of the fetal ultrasound image described in the first or second embodiment. Some or all of the steps in the output control method.
实施例七Embodiment 7
本发明实施例公开了一种计算机程序产品,该计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质,且该计算机程序可操作来使计算机执行实施例一或实施例二所描述的胎儿超声影像的检测结果的输出控制方法中部分或者全部的步骤。An embodiment of the present invention discloses a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the description in the first embodiment or the second embodiment. Part or all of the steps in the output control method of the detection result of the fetal ultrasound image.
以上所描述的装置实施例仅是示意性的,其中所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块输出的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components output as modules may or may not be physical modules, that is, they may be located in One place, or it can be distributed over multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
通过以上的实施例的具体描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,存储介质包括只读存储器(Read-Only Memory,ROM)、随机存储器(Random Access Memory,RAM)、可编程只读存储器(Programmable Read-only Memory,PROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory,EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory,OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其他介质。From the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation manner can be implemented by means of software plus a necessary general hardware platform, and certainly can also be implemented by means of hardware. Based on this understanding, the above-mentioned technical solutions can be embodied in the form of software products in essence or that make contributions to the prior art. The computer software products can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory. (Read-Only Memory, ROM), Random Access Memory (Random Access Memory, RAM), Programmable Read-only Memory (PROM), Erasable Programmable Read Only Memory (EPROM) ), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read -Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.
最后应说明的是:本发明实施例公开的一种胎儿超声影像的检测结果的输出控制方法胎儿超声影像的检测结果的输出控制方法、装置及系统所揭露的仅为本发明较佳实施例而已,仅用于说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解;其依然可以对前述各项实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或替换,并不使相应的技术方案的本质脱离本发明各项实施例技术方案的精神和范围。Finally, it should be noted that: the output control method, device and system for outputting detection results of fetal ultrasound images disclosed in the embodiments of the present invention are only preferred embodiments of the present invention. , only used to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand; it can still be described in the foregoing embodiments. The technical solutions of the present invention are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

  1. 一种胎儿超声影像的检测结果的输出控制方法,其特征在于,所述方法应用于智能检测系统中,所述方法包括:A method for controlling the output of detection results of fetal ultrasound images, characterized in that the method is applied in an intelligent detection system, and the method comprises:
    所述智能检测系统将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析,并获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果;The intelligent detection system inputs the received fetal ultrasound image into the determined image analysis model for analysis, and obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image;
    所述智能检测系统控制与所述智能检测系统对应的输出终端输出所述检测结果;The intelligent detection system controls the output terminal corresponding to the intelligent detection system to output the detection result;
    其中,所述检测结果包括所述胎儿超声影像的多个特征的检测结果,每个所述特征的检测结果包括该特征的检测标识,每个所述特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种,所述已检且疑似特征为被检测到且不确定类别的特征,所述已检且异常特征为已经被检测且存在异常结构特征的特征。The detection result includes detection results of multiple features of the fetal ultrasound image, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of a feature to be checked, a checked and normal feature, a checked and suspected feature, and a checked and abnormal feature, the checked and suspected feature is a feature of a detected and uncertain category, the checked and Anomalous features are features that have been detected and that have anomalous structural features.
  2. 根据权利要求1所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述方法还包括:The output control method of the detection result of the fetal ultrasound image according to claim 1, wherein the method further comprises:
    所述智能检测系统根据所述胎儿超声影像包括的所有所述特征的目标信息,判断所有所述特征中是否存在确定出的重点检测特征;The intelligent detection system judges whether there is a determined key detection feature in all the features according to the target information of all the features included in the fetal ultrasound image;
    当判断出所述胎儿超声影像包括的所有所述特征存在至少一个所述重点检测特征时,所述智能检测系统控制所述输出终端输出与每个所述重点检测特征对应的切面示意图,每个所述重点检测特征对应的切面示意图包括该重点检测特征对应的标准切面中每个结构特征的输出标识;When it is determined that all the features included in the fetal ultrasound image have at least one of the key detection features, the intelligent detection system controls the output terminal to output a schematic diagram of a section corresponding to each of the key detection features, and each The schematic diagram of the section corresponding to the key detection feature includes the output identification of each structural feature in the standard section corresponding to the key detection feature;
    所述智能检测系统根据每个所述重点检测特征对应的切面示意图包括的每个所述输出标识的变化情况确定该输出标识对应的结构特征的检测情况;The intelligent detection system determines the detection situation of the structural feature corresponding to the output mark according to the change of each of the output marks included in the schematic section diagram corresponding to each of the key detection features;
    其中,对于任一所述重点检测特征,当所述重点检测特征对应的切面示意图包括的每个所述输出标识的变化情况用于表示该输出标识从第一状态变为第二状态时,每个所述输出标识对应的结构特征的检测情况用于表示该结构特征在对应的标准切面中被检测到。Wherein, for any one of the key detection features, when the change of each of the output signs included in the schematic section diagram corresponding to the key detection feature is used to indicate that the output sign changes from the first state to the second state, each The detection situation of the structural feature corresponding to each of the output identifiers is used to indicate that the structural feature is detected in the corresponding standard section.
  3. 根据权利要求1或2所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述输出终端的输出界面包括第一区域和第二区域,所述第一区域用于输出所述检测结果,所述第二区域用于输出所述胎儿超声影像对应的待检特征清单和已检特征清单,所述待检特征清单用于存储确定出的所述胎儿超声图像的多个待检特征,所述已检特征清单用于存储所述胎儿超声图像的多个已检特征,且所述待检特征清单所包括的所有待检特征的类别包括所述已检特征清单所包括的所有所述已检特征的类别,所述胎儿超声影像包括的多个所述特征的类别包括所述待检特征清单所包括的所有所述待检特征的类别。The method for outputting detection results of fetal ultrasound images according to claim 1 or 2, wherein the output interface of the output terminal includes a first area and a second area, and the first area is used to output the The detection result, the second area is used to output a list of features to be checked and a list of checked features corresponding to the fetal ultrasound image, and the list of features to be checked is used to store a plurality of pieces of the determined ultrasound image of the fetus to be checked feature, the checked feature list is used to store a plurality of checked features of the fetal ultrasound image, and the categories of all the features to be checked included in the feature list to be checked include all the features included in the checked feature list The categories of the detected features, the plurality of categories of the features included in the fetal ultrasound image include all categories of the features to be detected included in the list of features to be checked.
  4. 根据权利要求1-3任一项所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述胎儿超声影像包括的所有所述特征包括所述胎儿超声影像的多个结构特征,每个所述特征的检测结果还包括该特征的特征参数,每个所述特征的特征参数包括该特征的类别信息;The method for outputting a detection result of a fetal ultrasound image according to any one of claims 1 to 3, wherein all the features included in the fetal ultrasound image include multiple structural features of the fetal ultrasound image, The detection result of each of the features also includes the feature parameters of the feature, and the feature parameters of each of the features include the category information of the feature;
    以及,所述智能检测系统获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,所述方法还包括:And, after the intelligent detection system obtains the analysis result output by the image analysis model as the detection result of the fetal ultrasound image, the method further includes:
    所述智能检测系统确定所述胎儿超声影像包括的每个所述结构特征所在帧胎儿超声图像的部位特征,并确定每个所述部位特征的特征参数,每个所述部位特征的特征参数包括该部位特征的类别信息;The intelligent detection system determines the part feature of the fetal ultrasound image of the frame where each of the structural features included in the fetal ultrasound image is located, and determines the feature parameter of each of the part features, and the feature parameters of each of the part features include: Category information of the feature of the part;
    所述智能检测系统根据每个所述特征的类别信息以及该特征对应的部位特征的类别信息,确定每个所述特征的标准切面,每个所述特征的检测结果还包括该特征的标准切面的检测结果。The intelligent detection system determines the standard section of each feature according to the category information of each feature and the category information of the part feature corresponding to the feature, and the detection result of each feature also includes the standard section of the feature. test results.
  5. 根据权利要求1-4任一项所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述智能检测系统获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,所述方法还包括:The method for controlling the output of detection results of fetal ultrasound images according to any one of claims 1 to 4, wherein the intelligent detection system obtains the analysis results output by the image analysis model as the results of the fetal ultrasound images. After the detection result, the method further includes:
    所述智能检测系统判断是否检测到针对某一目标特征类别对应的胎儿超声图像触发的回放请求,所述回放请求用于请求回放所述目标特征类别对应的胎儿超声图像,且所述目标特征类别对应的胎儿超声图像包括所述目标特征类别对应的最优帧胎儿超声图像、所述目标特征类别对应的所有标准切面的胎儿超声图像、所述目标特征类别对应的所有章节的胎儿超声图像中的至少一种,所述胎儿超声影像包括所述目标特征类别对应的胎儿超声图像,所述目标特征类别包括目标结构特征类别和/或目标标准切面类别,每个所述章节包括的每个所述胎儿超声图像的标准切面的类别相同;The intelligent detection system determines whether a playback request triggered by a fetal ultrasound image corresponding to a certain target feature category is detected, and the playback request is used to request playback of the fetal ultrasound image corresponding to the target feature category, and the target feature category The corresponding fetal ultrasound images include the optimal frame fetal ultrasound images corresponding to the target feature category, fetal ultrasound images of all standard slices corresponding to the target feature category, and fetal ultrasound images of all chapters corresponding to the target feature category. At least one, the fetal ultrasound image includes a fetal ultrasound image corresponding to the target feature category, the target feature category includes a target structural feature category and/or a target standard slice category, and each of the sections included in each of the The same categories of standard slices of fetal ultrasound images;
    当判断结果为是时,所述智能检测系统根据所述回放请求确定所述目标特征类别对应的胎儿超声图像,并控制所述输出终端回放所述目标特征类别对应的胎儿超声图像。When the judgment result is yes, the intelligent detection system determines the fetal ultrasound image corresponding to the target feature category according to the playback request, and controls the output terminal to play back the fetal ultrasound image corresponding to the target feature category.
  6. 根据权利要求5所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述智能检测系统根据所述回放请求确定所述目标特征类别对应的胎儿超声图像,包括:The method for controlling the output of detection results of fetal ultrasound images according to claim 5, wherein the intelligent detection system determines the fetal ultrasound images corresponding to the target feature categories according to the playback request, comprising:
    当所述目标特征类别对应的胎儿超声图像为所述目标特征类别对应的最优帧胎儿超声图像时,所述智能检测系统确定所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值;When the fetal ultrasound image corresponding to the target feature category is the optimal frame fetal ultrasound image corresponding to the target feature category, the intelligent detection system determines that each of the standard slices corresponding to the target feature category The slice score of the standard slice;
    所述智能检测系统根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像。The intelligent detection system determines the frame fetus corresponding to the standard slice corresponding to the highest slice score from all the standard slices according to the slice score of each of the standard slices corresponding to the target feature category. The ultrasound image is taken as the optimal frame fetal ultrasound image corresponding to the target feature category.
  7. 根据权利要求6所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述智能检测系统根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像之前,所述方法还包括:The method for outputting the detection results of fetal ultrasound images according to claim 6, wherein the intelligent detection system is based on the slice score of each of the standard slices in all the standard slices corresponding to the target feature categories before determining the frame fetal ultrasound image corresponding to the standard slice corresponding to the highest slice score from all the standard slices as the optimal frame fetal ultrasound image corresponding to the target feature category, the method further includes:
    当所述目标特征类别为所述目标结构特征类别时,所述智能检测系统判断所述目标特征类别是否对应至少两个匹配特征类别,至少两个所述匹配特征类别包括至少两个匹配标准切面类别或至少两个匹配章节类别;When the target feature category is the target structure feature category, the intelligent detection system determines whether the target feature category corresponds to at least two matching feature categories, and the at least two matching feature categories include at least two matching standard slices category or at least two matching chapter categories;
    当判断结果为否时,触发执行所述的根据所述目标特征类别对应的所有所述标准切面中每个所述标准切面的切面分值,从该所有标准切面中确定最高切面分值对应的标准切面所对应的帧胎儿超声图像,作为所述目标 特征类别对应的最优帧胎儿超声图像的操作;When the judgment result is no, trigger the execution of the slice score of each of the standard slices in all the standard slices corresponding to the target feature category, and determine the slice corresponding to the highest slice score from all the standard slices The frame fetal ultrasound image corresponding to the standard slice is used as the operation of the optimal frame fetal ultrasound image corresponding to the target feature category;
    当判断结果为是时,所述智能检测系统确定所述目标特征类别对应的每个所述匹配特征类别对应的所有标准切面中每个所述标准切面的切面分值,并根据每个所述匹配特征类别对应的每个所述标准切面的切面分值,从所有该标准切面中筛选最高切面分值对应的帧胎儿超声图像,并确定所有所述匹配特征类别对应的帧胎儿超声图像,作为所述目标特征类别对应的最优帧胎儿超声图像,该目标特征类别对应的最优帧胎儿超声图像的数量大于1。When the judgment result is yes, the intelligent detection system determines the slice score of each of the standard slices in all standard slices corresponding to each of the matching feature categories corresponding to the target feature category, and determines the slice score of each of the standard slices according to each of the standard slices. The slice score of each of the standard slices corresponding to the matching feature categories is selected, the frame fetal ultrasound images corresponding to the highest slice score are selected from all the standard slices, and the frame fetal ultrasound images corresponding to all the matching feature categories are determined as The optimal frame fetal ultrasound image corresponding to the target feature category, and the number of the optimal frame fetal ultrasound image corresponding to the target feature category is greater than 1.
  8. 根据权利要求1-7任一项所述的胎儿超声影像的检测结果的输出控制方法,其特征在于,所述智能检测系统获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果之后,所述方法还包括:The method for controlling the output of detection results of fetal ultrasound images according to any one of claims 1 to 7, wherein the intelligent detection system acquires the analysis results output by the image analysis model as the results of the fetal ultrasound images. After the detection result, the method further includes:
    所述智能检测系统判断所述胎儿超声影像包括的所有所述特征中是否存在异常特征,当判断结果为是时,从所述胎儿超声影像包括的所有所述特征中筛选所有所述异常特征;The intelligent detection system determines whether there are any abnormal features in all the features included in the fetal ultrasound image, and when the determination result is yes, selects all the abnormal features from all the features included in the fetal ultrasound image;
    所述智能检测系统按照确定出的排序方式对所有所述异常特征进行排序,得到排序后的所有所述异常特征,控制所述输出终端输出排序后的所有所述异常特征。The intelligent detection system sorts all the abnormal features according to the determined sorting method, obtains all the sorted abnormal features, and controls the output terminal to output all the sorted abnormal features.
  9. 一种胎儿超声影像的检测结果的输出控制装置,其特征在于,所述装置应用于智能检测系统中,且所述装置包括:An output control device for detection results of fetal ultrasound images, characterized in that the device is applied in an intelligent detection system, and the device comprises:
    分析模块,用于将接收到的胎儿超声影像输入确定出的影像分析模型中进行分析;The analysis module is used for inputting the received fetal ultrasound image into the determined image analysis model for analysis;
    获取模块,用于获取所述影像分析模型输出的分析结果,作为所述胎儿超声影像的检测结果;an acquisition module, configured to acquire the analysis result output by the image analysis model as the detection result of the fetal ultrasound image;
    控制模块,用于控制与所述智能检测系统对应的输出终端输出所述检测结果;a control module, configured to control the output terminal corresponding to the intelligent detection system to output the detection result;
    其中,所述检测结果包括所述胎儿超声影像的多个特征的检测结果,每个所述特征的检测结果包括该特征的检测标识,每个所述特征对应的检测标识用于表示该特征为待检特征、已检且正常特征、已检且疑似特征以及已检且异常特征中的其中一种,所述已检且疑似特征为被检测到且不确定类别的特征,所述已检且异常特征为已经被检测且存在异常结构特征的特征。Wherein, the detection result includes detection results of multiple features of the fetal ultrasound image, the detection result of each feature includes a detection identifier of the feature, and the detection identifier corresponding to each feature is used to indicate that the feature is One of a feature to be checked, a checked and normal feature, a checked and suspected feature, and a checked and abnormal feature, the checked and suspected feature is a feature of a detected and uncertain category, the checked and suspected feature Anomalous features are features that have been detected and that have anomalous structural features.
  10. 一种智能检测系统,其特征在于,所述智能检测系统用于执行如权利要求1-8任一项所述的胎儿超声影像的检测结果的输出控制方法。An intelligent detection system, characterized in that, the intelligent detection system is used for executing the output control method of the detection result of the fetal ultrasound image according to any one of claims 1-8.
PCT/CN2021/096816 2020-09-24 2021-05-28 Method and apparatus for controlling output of detection result of fetal ultrasound image, and system WO2022062456A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011016791.9A CN112215806A (en) 2020-09-24 2020-09-24 Output control method, device and system for detection result of fetus ultrasonic image
CN202011016791.9 2020-09-24

Publications (1)

Publication Number Publication Date
WO2022062456A1 true WO2022062456A1 (en) 2022-03-31

Family

ID=74052493

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/096816 WO2022062456A1 (en) 2020-09-24 2021-05-28 Method and apparatus for controlling output of detection result of fetal ultrasound image, and system

Country Status (2)

Country Link
CN (1) CN112215806A (en)
WO (1) WO2022062456A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117115164A (en) * 2023-10-24 2023-11-24 广州爱孕记信息科技有限公司 Automatic detection method and device for structural features

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112155601B (en) * 2020-09-24 2022-12-30 广州爱孕记信息科技有限公司 Method and device for determining imaging quality control of fetal ultrasound image
CN112155603B (en) * 2020-09-24 2023-06-09 广州爱孕记信息科技有限公司 Weight value determining method and device for fetal structural characteristics
CN112215806A (en) * 2020-09-24 2021-01-12 广州爱孕记信息科技有限公司 Output control method, device and system for detection result of fetus ultrasonic image
CN114255867B (en) * 2021-12-22 2024-01-16 华中科技大学协和深圳医院 Ultrasonic image detection method, device, equipment and medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111329A (en) * 2019-05-17 2019-08-09 四川大学华西第二医院 One kind being based on artificial intelligence ultrasonic image detection method and system
US20190313999A1 (en) * 2016-11-18 2019-10-17 Samsung Medison Co., Ltd. Ultrasonic diagnostic device and operation method thereof
CN110613480A (en) * 2019-01-14 2019-12-27 广州爱孕记信息科技有限公司 Fetus ultrasonic dynamic image detection method and system based on deep learning
CN110742654A (en) * 2019-11-05 2020-02-04 深圳度影医疗科技有限公司 Method for positioning and measuring standard tangent plane based on three-dimensional ultrasonic image
CN112215806A (en) * 2020-09-24 2021-01-12 广州爱孕记信息科技有限公司 Output control method, device and system for detection result of fetus ultrasonic image

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104394771B (en) * 2012-06-04 2017-07-04 泰尔哈绍梅尔医学研究基础设施和服务有限公司 Ultrasonoscopy treatment
KR102017069B1 (en) * 2017-08-25 2019-09-02 연세대학교 산학협력단 Method for measuring fetal body and device for measuring fetal body using the same
CN109276275A (en) * 2018-10-26 2019-01-29 深圳开立生物医疗科技股份有限公司 A kind of extraction of ultrasound image standard section and measurement method and ultrasonic diagnostic equipment
CN110634125B (en) * 2019-01-14 2022-06-10 广州爱孕记信息科技有限公司 Deep learning-based fetal ultrasound image identification method and system
CN110613483B (en) * 2019-09-09 2022-05-20 南方医科大学 System for detecting fetal craniocerebral abnormality based on machine learning
CN111340775B (en) * 2020-02-25 2023-09-29 湖南大学 Parallel method, device and computer equipment for acquiring ultrasonic standard section

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190313999A1 (en) * 2016-11-18 2019-10-17 Samsung Medison Co., Ltd. Ultrasonic diagnostic device and operation method thereof
CN110613480A (en) * 2019-01-14 2019-12-27 广州爱孕记信息科技有限公司 Fetus ultrasonic dynamic image detection method and system based on deep learning
CN110111329A (en) * 2019-05-17 2019-08-09 四川大学华西第二医院 One kind being based on artificial intelligence ultrasonic image detection method and system
CN110742654A (en) * 2019-11-05 2020-02-04 深圳度影医疗科技有限公司 Method for positioning and measuring standard tangent plane based on three-dimensional ultrasonic image
CN112215806A (en) * 2020-09-24 2021-01-12 广州爱孕记信息科技有限公司 Output control method, device and system for detection result of fetus ultrasonic image

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117115164A (en) * 2023-10-24 2023-11-24 广州爱孕记信息科技有限公司 Automatic detection method and device for structural features
CN117115164B (en) * 2023-10-24 2024-02-27 广州爱孕记信息科技有限公司 Automatic detection method and device for structural features

Also Published As

Publication number Publication date
CN112215806A (en) 2021-01-12

Similar Documents

Publication Publication Date Title
WO2022062456A1 (en) Method and apparatus for controlling output of detection result of fetal ultrasound image, and system
WO2022062461A1 (en) Fetal section determination method and device based on ultrasonic dynamic image
WO2022062458A1 (en) Method and apparatus for determining optimal fetal standard view
CN110390229B (en) Face picture screening method and device, electronic equipment and storage medium
TW202036353A (en) Solder paste printing quality detecting method, data processing device and computer storage medium
WO2022062460A1 (en) Method and device for determining imaging quality control of fetal ultrasound image
US7643674B2 (en) Classification methods, classifier determination methods, classifiers, classifier determination devices, and articles of manufacture
CN111339891A (en) Target detection method of image data and related device
WO2024051597A1 (en) Standard pull-up counting method, and system and storage medium therefor
CN112381054A (en) Method for detecting working state of camera and related equipment and system
CN114049895B (en) ASR-based voice quality inspection analysis method and system
WO2022062459A1 (en) Automatic measurement method and device for fetal structural characteristic
US11961230B2 (en) Discerning device, cell mass discerning method, and computer program
CN115564776B (en) Abnormal cell sample detection method and device based on machine learning
CN115376210B (en) Drowning behavior identification method, device, equipment and medium for preventing drowning in swimming pool
CN112155603B (en) Weight value determining method and device for fetal structural characteristics
CN115116090A (en) Pedestrian re-identification method, system and storage medium
CN113269268A (en) Data matching method and system based on big data and cloud platform
CN112396498A (en) Commodity sales promotion method, device, equipment and storage medium
CN110610344A (en) Method, device and equipment for improving auditing speed of automatic auditing system
CN115331217B (en) Dining settlement method, device, equipment and medium
JP3074691B2 (en) Character recognition device
Damayanti et al. DETERMINATION OF COFFEE FRUIT MATURITY LEVEL USING IMAGE HISTOGRAM AND K-NEAREST NEIGHBOR
CN117252838A (en) Embryo quality analysis system and method based on artificial intelligence
CN117857888A (en) Subtitle matching method, subtitle matching device, electronic equipment and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21870843

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21870843

Country of ref document: EP

Kind code of ref document: A1