WO2022194015A1 - Area-by-area completeness self-checking method of capsule endoscope, electronic device, and readable storage medium - Google Patents

Area-by-area completeness self-checking method of capsule endoscope, electronic device, and readable storage medium Download PDF

Info

Publication number
WO2022194015A1
WO2022194015A1 PCT/CN2022/080076 CN2022080076W WO2022194015A1 WO 2022194015 A1 WO2022194015 A1 WO 2022194015A1 CN 2022080076 W CN2022080076 W CN 2022080076W WO 2022194015 A1 WO2022194015 A1 WO 2022194015A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
working
capsule endoscope
virtual positioning
voxel
Prior art date
Application number
PCT/CN2022/080076
Other languages
French (fr)
Chinese (zh)
Inventor
杨戴天杙
Original Assignee
安翰科技(武汉)股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 安翰科技(武汉)股份有限公司 filed Critical 安翰科技(武汉)股份有限公司
Publication of WO2022194015A1 publication Critical patent/WO2022194015A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00006Operational features of endoscopes characterised by electronic signal processing of control signals
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00057Operational features of endoscopes provided with means for testing or calibration
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/041Capsule endoscopes for imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/273Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the upper alimentary canal, e.g. oesophagoscopes, gastroscopes

Definitions

  • the invention relates to the field of medical equipment, and in particular, to a self-checking method, equipment and readable storage medium for partition completeness of a capsule endoscope.
  • Capsule endoscopy is increasingly used for gastrointestinal examination.
  • Capsule endoscopes are taken orally, passed through the mouth, esophagus, stomach, small intestine, large intestine, and finally excreted from the body.
  • the capsule endoscope runs passively with the peristalsis of the digestive tract, and captures images at a certain frame rate during the process, so that doctors can check the health of each section of the patient's digestive tract.
  • capsule endoscopes Compared with traditional intubation endoscopes, capsule endoscopes have the advantages of no risk of cross-infection, no damage to the human body, and good tolerance.
  • traditional endoscopes have high controllability, and at the same time, after long-term operation, relatively complete operating procedures have been summarized to ensure the relative completeness of inspection, while the self-inspection scheme of the completeness of new technology capsule endoscopes There is still something missing.
  • the controllability of the capsule endoscope is poor, which is affected by the peristalsis and movement of the detection space, which leads to the randomness of the capsule endoscope shooting. That is, there is a missed shot.
  • it is also affected by poor maneuverability and lack of position and attitude feedback, so it is difficult to form a good operating procedure to ensure the completeness of the inspection.
  • the capsule endoscope lacks the function of cleaning the lens, resulting in a significantly lower image resolution than the intubation endoscope, so its image quality cannot be guaranteed to be always clear. The above problems will lead to the lack of completeness of capsule endoscopy.
  • the purpose of the present invention is to provide a self-checking method, electronic device and readable storage medium for partition completeness of a capsule endoscope.
  • an embodiment of the present invention provides a method for self-checking the partition completeness of a capsule endoscope, the method includes: acquiring a working area of the capsule endoscope, and dividing the working area into multiple a sub-work area, any line passing through any sub-work area has at most two intersection points with the current sub-work area;
  • the virtual positioning area and the working area are in the same spatial coordinate system, and the virtual positioning area completely covers the working area;
  • each of the virtual positioning areas into a plurality of adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates;
  • step A synchronously to scan the body in each virtual positioning area.
  • the voxel is marked with a lighting mark, and for each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously;
  • each voxel point is not marked with a lighted mark
  • Step A includes:
  • the capsule endoscope is driven to move in the working area, and the images captured when the capsule endoscope reaches each working point are sequentially recorded according to a predetermined frequency, and step A is performed synchronously.
  • Lighting flags to label voxels include:
  • step A Score the images obtained at each work point. If the score of the image obtained corresponding to the current work point is not less than the preset score, step A is performed synchronously. If the score of the image obtained corresponding to the current work point is less than the preset score, Then, step A is skipped for the current working point.
  • step A when step A is performed, the method further includes:
  • the virtual positioning area where the capsule endoscope is currently located at any working point is not unique, the virtual positioning area with the smallest volume is used as the virtual positioning area corresponding to the current working point by default.
  • marking the voxel points that are in the intersection area and are not marked with a lighting mark includes:
  • the intersection area obtain the line of sight vector of the current working point and each voxel that is not marked with a lighted mark, and at the same time, according to the acquisition order of the intersection area, the line of sight vector corresponding to each voxel is merged into the same vector set. ;
  • step A when step A is performed, the method further includes:
  • the distance between the two positioning points is less than the preset distance threshold, and the angle between the viewing directions of the two positioning points is smaller than the preset angle threshold, then the vector intersecting within the field of view of the two current positioning points is traversed.
  • the calculation of the angle between each voxel in the intersecting range of the visual field and the two line-of-sight vectors corresponding to the two positioning points is omitted.
  • the method further includes:
  • the method further includes:
  • each of the virtual positioning areas is configured to be spherical.
  • an embodiment of the present invention provides an electronic device, including a memory and a processor, the memory stores a computer program that can be executed on the processor, and the processor executes the program At the time, the steps in the self-checking method of the partition completeness of the capsule endoscope as described above are implemented.
  • an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the partition completeness of the capsule endoscope as described above is realized. Steps in the Sexual Self-Test Method.
  • the beneficial effects of the present invention are: the self-checking method, device and readable storage medium for the partition completeness of the capsule endoscope of the present invention divide the working area into sub-working areas composed of convex curved surfaces, corresponding to Each sub-working area establishes a virtual positioning area under the same spatial coordinate system as it, and when the sub-working area intersects with the virtual positioning area, it will be marked and illuminated, which can realize the completeness self-check of the capsule endoscope and improve the detection probability.
  • FIG. 1 is a schematic flowchart of a self-checking method for partition completeness of a capsule endoscope according to an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of step A in FIG. 1 .
  • FIG. 3 is a schematic structural diagram of a specific example of the present invention.
  • FIG. 4 is a schematic structural diagram of another specific example of the present invention.
  • a first embodiment of the present invention provides a self-checking method for the completeness of a partition of a capsule endoscope, and the method includes the following steps.
  • a virtual positioning area is correspondingly established for each sub-working area, the virtual positioning area and the working area are in the same space coordinate system, and the virtual positioning area completely covers the working area.
  • each of the virtual positioning areas into a plurality of adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates.
  • step A Drive the capsule endoscope to move in the working area, and sequentially record the images captured by the capsule endoscope when it reaches each working point according to a predetermined frequency, and perform step A synchronously to locate the images in each virtual positioning area. For each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously.
  • each voxel point is not marked with a lighted mark.
  • step A includes the following specific steps:
  • step S1 after the capsule endoscope reaches the working area, it traverses the working area quickly to outline the outline of the working area. Further, the key areas in the work area are retrieved and located according to the specific work environment, the coordinates of key points are obtained in each key area, and after connecting the key points in sequence, the work area composed of key points is formed. .
  • a virtual stomach environment is taken as an example for a specific introduction.
  • the key regions of the stomach include: the cardia, fundus, lesser curvature, greater curvature, gastric angle, pylorus and Pyloric sinus area, after the capsule endoscope quickly traverses the working area, the working area composed of curved surfaces can be drawn.
  • the more sampling points in each key area the smoother the surface of the work area, and accordingly, the amount of calculation will increase. Further, the coordinates of several working points are acquired in the key area of each stomach, and are connected by straight lines in sequence to form the working area.
  • the Chinese patent application with the extension publication number: CN110335318A is "a method for measuring objects in the digestive tract based on a camera system"
  • the extension publication number: CN110327046A is "a kind of The Chinese patent application of "Method for Measuring Objects in Digestive Tract Based on Camera System” can roughly estimate the coordinates of a certain working point in each key area, and then connect the obtained coordinates in a straight line to form the work described in the steps of the present invention. area.
  • the work area is divided into a plurality of sub-work areas.
  • the best division method is to take the division method with the fewest sub-work areas.
  • any straight line passing through any sub-working area has at most two intersection points with the current sub-working area, that is, each sub-working area is a convex surface structure.
  • a sub-working area with any surface protruding to the outside is defined as a sub-working area of a convex curved surface.
  • a virtual positioning area is correspondingly established for each sub-working area.
  • the shapes of the plurality of virtual positioning areas are the same.
  • the virtual positioning area is configured as a sphere. For convenience of illustration, only one section is shown in the example of FIG. 3 .
  • each virtual positioning area covers its corresponding sub-working area.
  • each voxel is configured as a cube, and the range of its side length is ⁇ [1mm, 5mm].
  • each voxel has a unique identification and coordinates, and the identification is, for example, a number.
  • the coordinate may be a fixed position coordinate value of each voxel, for example, one of the corner coordinate values.
  • the coordinate value of the center point of each voxel is used as the coordinate value corresponding to the current voxel.
  • a platform can be set up, and after the user is in the monitoring area of the platform, a virtual positioning area is automatically constructed according to the user's position, and during the working process of the capsule endoscope, the user is always in the monitoring area. , in this way, it is ensured that the virtual positioning area and the working area are in the same space coordinate system.
  • each working point is recorded according to a predetermined frequency, and according to specific requirements, you can Selectively record the image taken at each work point, the spatial coordinate value P(x, y, z) of each work point, and the view direction M.
  • the field of view orientation here is the posture of the capsule endoscope, such as Euler angles (yaw, pitch, roll), or it can be a four-element or vector coordinate of orientation. Through the field of view orientation, you can know the field of view captured by the capsule endoscope in the M direction at the current coordinate point.
  • the field of view is oriented in a cone shape starting from the current coordinate point, and its vector direction is That is, the extension direction of the axis of the cone.
  • the steps of capturing an image through a capsule endoscope, locating its position coordinates, and the direction of the recorder's field of view are all steps in the prior art, and will not be further described here.
  • step S3 further includes: scoring the images obtained at each work point, and if the score of the images obtained corresponding to the current work point is not less than the preset score, then step A is performed synchronously. If the score of the acquired image corresponding to the point is less than the preset score, then step A is skipped for the current work point.
  • Scoring images can be done in a number of ways, which are known in the art. For example: Authorized Announcement No. CN111932532B, the Chinese patent titled "A Method for Evaluation of Capsule Endoscope Without Reference Image, Electronic Device and Medium” is cited in this application.
  • the score of the present invention may be the image quality evaluation score and/or the image content evaluation score and/or the comprehensive score of the extended patent, which will not be repeated here.
  • step A is performed synchronously to mark the voxel with a lighted mark.
  • the proportion of the voxel in the current virtual positioning area When it is not less than the preset ratio threshold, step A is no longer performed synchronously.
  • each voxel point is by default an unmarked lighted mark, and the lighted mark is a general mark.
  • the voxel point is marked, and its mark.
  • different voxel points are illuminated in sequence, and then the detection progress of the working area is determined by the proportion of voxels marked with the illuminated logo.
  • all voxels may be turned on in an initial state, and each voxel may be turned off in sequence in the order of step A, which will not be repeated here.
  • each sub-working area is a convex surface. In this way, taking any working point in the current sub-working area as the shooting angle, there is no occlusion in its field of view, so that the shooting field of view formed by taking this working point as the shooting angle, all the voxels inside can be completely photographed .
  • the working area is divided into two sub-working areas, and the two sub-working areas are respectively covered by a larger virtual positioning area X1 and a smaller virtual positioning area X2.
  • step A for each working point, its truncated cone area can be calculated according to its corresponding field of view orientation.
  • the frustum region and the spherical virtual positioning region have an intersection region. Take the coordinate point P1, whose field of view faces M as an example, and the intersection area is A1.
  • the capsule endoscope is at the coordinate point P1, all voxels in the intersection area A1 are marked with lit marks.
  • the virtual positioning area where the capsule endoscope is currently located at any working point is not unique, the virtual positioning area where the voxel points are not all lit and the volume is the smallest is set as the corresponding current working point by default. the virtual positioning area of
  • the sub-working regions that are in the intersection region and are not marked Marking the lighting mark on the voxel points with the lighting mark includes: in the intersection area, obtaining the line of sight vector of the current working point and each voxel that is not marked with the lighting mark; Merge the line-of-sight vectors corresponding to each voxel into the same vector set; traverse the vector set, if the number of line-of-sight vectors in any of the vector sets is at least 2, and the included angle between the two line-of-sight vectors is greater than the preset folder When the angle threshold is set, the voxel corresponding to the current vector set is marked with a lighted mark.
  • the method further includes: if the distance between the two positioning points is less than a preset distance threshold, and the angle between the viewing directions of the two positioning points is less than Preset the included angle threshold, when traversing the vector set intersecting within the field of view of the current two positioning points, omit the angle between each voxel within the intersecting range of the field of view and the two line-of-sight vectors corresponding to the two positioning points. calculate.
  • the intersection area may be approximately coincident. At this time, the voxel points in the intersection area are likely not to be marked with lit marks. In this way, by adding this step, the calculation amount can be reduced on the premise of ensuring the accuracy of the calculation result.
  • the two positioning points described here are usually two coordinate points that are located in the same detection area and are obtained in sequence, and details are not described here.
  • each voxel point in the virtual positioning area will be marked in turn.
  • each voxel point in the virtual positioning area will be lit up, but in actual operation , the interference of various factors will lead to errors. Therefore, the present invention sets a preset ratio threshold.
  • the proportion of the voxels marked with the lit logo in the virtual positioning area is not less than the preset ratio threshold, it means that the monitoring range of the capsule endoscope complies with the standard. In this way, the completeness self-check of the capsule endoscope can be assisted by marking the voxels in the virtual positioning area with lit signs.
  • the detection result is visualized, and the user can assist in verifying the detection area of the capsule endoscope by observing the lighted mark marked in the virtual positioning area, which will not be repeated here.
  • the method further includes: judging in real time whether the proportion of the voxel points marked with the lit logo in the virtual positioning area is not less than a preset proportion threshold, and if so, driving the capsule endoscope to exit the working mode; if not, driving the capsule endoscope.
  • the capsule endoscope continues working mode.
  • the method further includes: when the capsule endoscope runs for a preset working time in the working area, judging whether the proportion of the voxel points marked with the lit logo in the virtual positioning area is not less than a preset proportion threshold, and if so, Drive the capsule endoscope to exit the working mode; if not, drive the capsule endoscope to continue the working mode.
  • the working area can be observed from multiple perspectives, and the number of images taken in the same area can be increased under the multi-perspective judgment criteria, which not only ensures the shooting quality Completeness, you can also observe the same area from multiple angles in the post-image application to achieve a better observation effect and improve the detection rate.
  • an embodiment of the present invention provides an electronic device, including a memory and a processor, the memory stores a computer program that can run on the processor, and when the processor executes the program, the above-mentioned Describe the steps in the self-checking method of partition completeness of capsule endoscope.
  • an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, realizes the above-mentioned partition completeness self-checking method of a capsule endoscope. A step of.
  • the self-checking method, device and readable storage medium of the partition completeness of the capsule endoscope of the present invention divide the working area into sub-working areas composed of convex curved surfaces, and each sub-working area is established in the same space as the sub-working area.
  • the virtual positioning area under the coordinate system is marked and illuminated when the sub-working area intersects with the virtual positioning area, which can realize the completeness self-check of the capsule endoscope and improve the detection probability.
  • the visualization of the detection effect can also be realized, and the convenience of the operation of the capsule endoscope can be improved.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Gastroenterology & Hepatology (AREA)
  • Signal Processing (AREA)
  • Endoscopes (AREA)

Abstract

Provided in the present invention are an area-by-area completeness self-checking method of a capsule endoscope, an electronic device, and a readable storage medium, the method comprising: dividing a working area into multiple sub working areas; establishing a virtual positioning area corresponding to each sub working area; driving a capsule endoscope to move in the working area, photograph images, synchronously execute step A and, when the proportion of voxels marked with a light-up identifier is no less than a preset proportion value, no longer synchronously execute step A; step A comprises: recording in sequence the position in a spatial coordinate system and the field of view orientation of each working point; at each working point in sequence, confirming an intersection area; and marking with a light-up identifier the voxels located in an intersection area and unmarked with a light-up identifier. The present invention can implement completeness self-checking of a capsule endoscope.

Description

胶囊内窥镜的分区完备性自检方法、设备及可读存储介质Partition completeness self-checking method, device and readable storage medium of capsule endoscope
本申请要求了申请日为2021年03月17日,申请号为202110284699.9,发明名称为“胶囊内窥镜的分区完备性自检方法、设备及可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application with an application date of March 17, 2021, an application number of 202110284699.9, and the invention titled "Sectional Integrity Self-Inspection Method, Device and Readable Storage Medium for Capsule Endoscope", The entire contents of which are incorporated herein by reference.
技术领域technical field
本发明涉及医疗设备领域,尤其涉及一种胶囊内窥镜的分区完备性自检方法、设备及可读存储介质。The invention relates to the field of medical equipment, and in particular, to a self-checking method, equipment and readable storage medium for partition completeness of a capsule endoscope.
背景技术Background technique
胶囊内窥镜用于消化道检查受到越来越多的应用。胶囊内窥镜由口服入,经过口腔、食管、胃、小肠、大肠,最后排出体外。通常,胶囊内窥镜随消化道蠕动而被动运行,并在这个过程中以一定的帧率拍摄图像,供医生检查患者的消化道各区段的健康状况。Capsule endoscopy is increasingly used for gastrointestinal examination. Capsule endoscopes are taken orally, passed through the mouth, esophagus, stomach, small intestine, large intestine, and finally excreted from the body. Usually, the capsule endoscope runs passively with the peristalsis of the digestive tract, and captures images at a certain frame rate during the process, so that doctors can check the health of each section of the patient's digestive tract.
相比传统插管内窥镜,胶囊内窥镜具有无交叉感染风险、对人体无损伤、耐受性好等优点。然而,传统内窥镜具有较高的可控性,同时经过长期的操作,已经总结出了相对完备的操作规程以保证检查的相对完备性,而新技术胶囊内窥镜完备性的自检方案还有所欠缺。Compared with traditional intubation endoscopes, capsule endoscopes have the advantages of no risk of cross-infection, no damage to the human body, and good tolerance. However, traditional endoscopes have high controllability, and at the same time, after long-term operation, relatively complete operating procedures have been summarized to ensure the relative completeness of inspection, while the self-inspection scheme of the completeness of new technology capsule endoscopes There is still something missing.
一方面,胶囊内窥镜的可控性较差,受检测空间蠕动、运动等影响,导致胶囊内窥镜拍摄存在随机性,即使使用外部磁控设备操作,也难以保证将检测空间拍全,即存在漏拍的情况。另一方面,同样是受到操控性差且缺少位置、姿态反馈的影响,难以形成很好的操作规程,来确保检查的完备性。另外,胶囊内窥镜缺少清洁镜头的功能,导致图像分辨率显著低于插管内窥镜,因此其图像质量也不能保证始终清晰。以上问题,均会导致胶囊内窥镜检查完备性的缺失。On the one hand, the controllability of the capsule endoscope is poor, which is affected by the peristalsis and movement of the detection space, which leads to the randomness of the capsule endoscope shooting. That is, there is a missed shot. On the other hand, it is also affected by poor maneuverability and lack of position and attitude feedback, so it is difficult to form a good operating procedure to ensure the completeness of the inspection. In addition, the capsule endoscope lacks the function of cleaning the lens, resulting in a significantly lower image resolution than the intubation endoscope, so its image quality cannot be guaranteed to be always clear. The above problems will lead to the lack of completeness of capsule endoscopy.
发明内容SUMMARY OF THE INVENTION
为解决上述技术问题,本发明的目的在于提供一种胶囊内窥镜的分区完备性自检方法、电子设备及可读存储介质。In order to solve the above-mentioned technical problems, the purpose of the present invention is to provide a self-checking method, electronic device and readable storage medium for partition completeness of a capsule endoscope.
为了实现上述发明目的之一,本发明一实施方式提供一种胶囊内窥镜的分区完备性自检方法,所述方法包括:获取胶囊内窥镜的工作区域,将所述工作区域划分为多个子工作区,任意穿过任一子工作区的直线,与当前子工作区最多具有两个交点;In order to achieve one of the above purposes of the invention, an embodiment of the present invention provides a method for self-checking the partition completeness of a capsule endoscope, the method includes: acquiring a working area of the capsule endoscope, and dividing the working area into multiple a sub-work area, any line passing through any sub-work area has at most two intersection points with the current sub-work area;
为每一子工作区对应建立一虚拟定位区域,所述虚拟定位区域与所述工作区域处于同一空间坐标系,所述虚拟定位区域完全包覆所述工作区域;Correspondingly establish a virtual positioning area for each sub-working area, the virtual positioning area and the working area are in the same spatial coordinate system, and the virtual positioning area completely covers the working area;
将每一所述虚拟定位区域划分为相邻、且大小相同的多个体素,每一所述体素具有唯一标识和坐标;dividing each of the virtual positioning areas into a plurality of adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates;
驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对每一虚拟定位区域内的体素标注点亮标识,分别对于每一虚拟定位区域,当标注点亮标识的体素在当前虚拟定位区域的占比不小于预设比例阈值时,不再同步执行步骤A;Drive the capsule endoscope to move in the working area, and sequentially record the images captured by the capsule endoscope when it reaches each working point according to a predetermined frequency, and perform step A synchronously to scan the body in each virtual positioning area. The voxel is marked with a lighting mark, and for each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously;
其中,初始状态下,每一体素点均未标注点亮标识;Among them, in the initial state, each voxel point is not marked with a lighted mark;
步骤A包括:Step A includes:
顺序记录每一工作点在所述空间坐标系中的位置及视野朝向;Sequentially record the position and view orientation of each working point in the space coordinate system;
依次在每一工作点,依据当前工作点的位置及视野朝向确认当前工作点下,胶囊内窥镜的视野与其当前处于的所述虚拟定位区域的交集区域;At each work point in turn, confirm the intersection area of the field of view of the capsule endoscope and the virtual positioning area currently located at the current work point according to the position of the current work point and the direction of the field of view;
对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识。Marking a lighting mark on the voxel points that are in the intersection area and are not marked with a lighting mark.
作为本发明一实施方式的进一步改进,驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对体素标注点亮标识包括:As a further improvement of an embodiment of the present invention, the capsule endoscope is driven to move in the working area, and the images captured when the capsule endoscope reaches each working point are sequentially recorded according to a predetermined frequency, and step A is performed synchronously. Lighting flags to label voxels include:
对每一工作点获取的图像进行评分,若当前工作点对应获取的图像的评分不小于预设分值,则同步执行步骤A,若当前工作点对应获取的图像的评分小于预设分值,则对当前工作点跳过执行步骤A。Score the images obtained at each work point. If the score of the image obtained corresponding to the current work point is not less than the preset score, step A is performed synchronously. If the score of the image obtained corresponding to the current work point is less than the preset score, Then, step A is skipped for the current working point.
作为本发明一实施方式的进一步改进,执行步骤A时,所述方法还包括:As a further improvement of an embodiment of the present invention, when step A is performed, the method further includes:
若任一工作点下,胶囊内窥镜当前处于的所述虚拟定位区域不唯一,则将体积最小的虚拟定位区域默认作为当前工作点对应的所述虚拟定位区域。If the virtual positioning area where the capsule endoscope is currently located at any working point is not unique, the virtual positioning area with the smallest volume is used as the virtual positioning area corresponding to the current working point by default.
作为本发明一实施方式的进一步改进,执行步骤A时,对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识包括:As a further improvement of an embodiment of the present invention, when step A is performed, marking the voxel points that are in the intersection area and are not marked with a lighting mark includes:
在所述交集区域内,获取当前工作点与未标注点亮标识的每一体素的视线向量,同时,按照所述交集区域的获取顺序、依次将每一体素对应的视线向量归并到同一向量集;In the intersection area, obtain the line of sight vector of the current working point and each voxel that is not marked with a lighted mark, and at the same time, according to the acquisition order of the intersection area, the line of sight vector corresponding to each voxel is merged into the same vector set. ;
遍历所述向量集,若任一所述向量集的视线向量的数量为至少2个,且存在两个视线向量的夹角大于预设夹角阈值时,对当前向量集对应的体素标注点亮标识。Traverse the vector set, if the number of sight vectors in any one of the vector sets is at least 2, and the included angle between the two sight vectors is greater than the preset angle threshold, mark the voxel corresponding to the current vector set. Bright logo.
作为本发明一实施方式的进一步改进,执行步骤A时,所述方法还包括:As a further improvement of an embodiment of the present invention, when step A is performed, the method further includes:
若两个定位点之间的距离小于预设距离阈值,且两个定位点的视野朝向之间的夹角小于预设夹角阈值,则在遍历当前两个定位点的视野范围内相交的向量集时,省略视野相交范围内的每一体素到两个定位点所对应的两个视线向量之间夹角的计算。If the distance between the two positioning points is less than the preset distance threshold, and the angle between the viewing directions of the two positioning points is smaller than the preset angle threshold, then the vector intersecting within the field of view of the two current positioning points is traversed. When set, the calculation of the angle between each voxel in the intersecting range of the visual field and the two line-of-sight vectors corresponding to the two positioning points is omitted.
作为本发明一实施方式的进一步改进,所述方法还包括:As a further improvement of an embodiment of the present invention, the method further includes:
实时判断标注点亮标识的体素点在每一虚拟定位区域的占比是否均不小于预设比例阈值,judging in real time whether the proportion of the voxel points marked with the lit logo in each virtual positioning area is not less than the preset proportion threshold,
若是,驱动胶囊内窥镜退出工作模式;If so, drive the capsule endoscope to exit the working mode;
若否,驱动胶囊内窥镜继续工作模式。If not, drive the capsule endoscope to continue working mode.
作为本发明一实施方式的进一步改进,所述方法还包括:As a further improvement of an embodiment of the present invention, the method further includes:
胶囊内窥镜在工作区域运行预设工作时长时,判断标注点亮标识的体素点在每一虚拟定位区域的占比是否均不小于预设比例阈值,When the capsule endoscope runs for a preset working time in the working area, it is judged whether the proportion of the voxel points marked with the lit logo in each virtual positioning area is not less than the preset proportion threshold, and
若是,驱动胶囊内窥镜退出工作模式;If so, drive the capsule endoscope to exit the working mode;
若否,驱动胶囊内窥镜继续工作模式。If not, drive the capsule endoscope to continue working mode.
作为本发明一实施方式的进一步改进,配置每一所述虚拟定位区域均为球形。As a further improvement of an embodiment of the present invention, each of the virtual positioning areas is configured to be spherical.
为了解决上述发明目的之一,本发明一实施方式提供一种电子设备,包括存储器和处理器,所述存储器存储有可在所述处理器上运行的计算机程序,所述处理器执行所述程序时,实现如上所述胶囊内窥镜的分区完备性自检方法中的步骤。In order to solve one of the above objects of the invention, an embodiment of the present invention provides an electronic device, including a memory and a processor, the memory stores a computer program that can be executed on the processor, and the processor executes the program At the time, the steps in the self-checking method of the partition completeness of the capsule endoscope as described above are implemented.
为了解决上述发明目的之一,本发明一实施方式提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现如上所述胶囊内窥镜的分区完备性自检方法中的步骤。In order to solve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the partition completeness of the capsule endoscope as described above is realized. Steps in the Sexual Self-Test Method.
与现有技术相比,本发明的有益效果是:本发明的胶囊内窥镜的分区完备性自检方法、设备及可读存储介质,将工作区域划分为凸曲面构成的子工作区,对应每个子工作区建立与其处于同一空间坐标系下的虚拟定位区域,并在子工作区与虚拟定位区域相交时进行标注点亮标识,可以实现胶囊内窥镜的完备性自检,提高检测概率。Compared with the prior art, the beneficial effects of the present invention are: the self-checking method, device and readable storage medium for the partition completeness of the capsule endoscope of the present invention divide the working area into sub-working areas composed of convex curved surfaces, corresponding to Each sub-working area establishes a virtual positioning area under the same spatial coordinate system as it, and when the sub-working area intersects with the virtual positioning area, it will be marked and illuminated, which can realize the completeness self-check of the capsule endoscope and improve the detection probability.
附图说明Description of drawings
图1是本发明一实施方式提供的胶囊内窥镜的分区完备性自检方法的流程示意图。FIG. 1 is a schematic flowchart of a self-checking method for partition completeness of a capsule endoscope according to an embodiment of the present invention.
图2是图1中步骤A的流程示意图。FIG. 2 is a schematic flowchart of step A in FIG. 1 .
图3是本发明一具体示例的结构示意图。FIG. 3 is a schematic structural diagram of a specific example of the present invention.
图4是本发明另一具体示例的结构示意图。FIG. 4 is a schematic structural diagram of another specific example of the present invention.
具体实施方式Detailed ways
以下将结合附图所示的具体实施方式对本发明进行详细描述。但这些实施方式并不限制本发明,本领域的普通技术人员根据这些实施方式所做出的结构、方法、或功能上 的变换均包含在本发明的保护范围内。The present invention will be described in detail below with reference to the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and the structural, method, or functional transformations made by those of ordinary skill in the art according to these embodiments are all included within the protection scope of the present invention.
结合图1、图2所示,本发明第一实施方式中提供一种胶囊内窥镜的分区完备性自检方法,所述方法包括下述步骤。Referring to FIG. 1 and FIG. 2 , a first embodiment of the present invention provides a self-checking method for the completeness of a partition of a capsule endoscope, and the method includes the following steps.
S1、获取胶囊内窥镜的工作区域,将所述工作区域划分为多个子工作区,任意穿过任一子工作区的直线,与当前子工作区最多具有两个交点;S1, obtaining the working area of the capsule endoscope, dividing the working area into a plurality of sub-working areas, and a straight line passing through any sub-working area arbitrarily has at most two intersections with the current sub-working area;
为每一子工作区对应建立一虚拟定位区域,所述虚拟定位区域与所述工作区域处于同一空间坐标系,所述虚拟定位区域完全包覆所述工作区域。A virtual positioning area is correspondingly established for each sub-working area, the virtual positioning area and the working area are in the same space coordinate system, and the virtual positioning area completely covers the working area.
S2、将每一所述虚拟定位区域划分为相邻、且大小相同的多个体素,每一所述体素具有唯一标识和坐标。S2. Divide each of the virtual positioning areas into a plurality of adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates.
S3、驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对每一虚拟定位区域内的体素标注点亮标识,分别对于每一虚拟定位区域,当标注点亮标识的体素在当前虚拟定位区域的占比不小于预设比例阈值时,不再同步执行步骤A。S3. Drive the capsule endoscope to move in the working area, and sequentially record the images captured by the capsule endoscope when it reaches each working point according to a predetermined frequency, and perform step A synchronously to locate the images in each virtual positioning area. For each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously.
其中,初始状态下,每一体素点均未标注点亮标识。Among them, in the initial state, each voxel point is not marked with a lighted mark.
其中,步骤A包括下述具体步骤:Wherein, step A includes the following specific steps:
顺序记录每一工作点在所述空间坐标系中的位置及视野朝向;Sequentially record the position and view orientation of each working point in the space coordinate system;
依次在每一工作点,依据当前工作点的位置及视野朝向确认当前工作点下,胶囊内窥镜的视野与其当前处于的所述虚拟定位区域的交集区域;At each work point in turn, confirm the intersection area of the field of view of the capsule endoscope and the virtual positioning area currently located at the current work point according to the position of the current work point and the direction of the field of view;
对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识。Marking a lighting mark on the voxel points that are in the intersection area and are not marked with a lighting mark.
对于步骤S1,胶囊内窥镜到达工作区域后,快速遍历工作区域以勾勒出工作区域的轮廓。进一步的,按照具体的工作环境对工作区域中的关键区域进行检索、定位,在每一关键区域中获取关键点坐标,且在依次连接各个关键点后,形成由关键点构成的所述工作区域。结合图3所示,本发明一具体示例中,以工作区域为虚拟的胃部环境为例做具体介绍,胃部关键区域包括:贲门、胃底、小弯、大弯、胃角、幽门以及幽门窦区域,胶囊内窥镜快速遍历工作区域后,可绘制出曲面构成的工作区域。其中,在每个关键区域的采样点越多,工作区域的曲面越光滑,相应的,计算量也会增加。进一步的,在每一胃部的关键区域中获取若干个工作点的坐标,并依次进行直线连接,形成所述工作区域。For step S1, after the capsule endoscope reaches the working area, it traverses the working area quickly to outline the outline of the working area. Further, the key areas in the work area are retrieved and located according to the specific work environment, the coordinates of key points are obtained in each key area, and after connecting the key points in sequence, the work area composed of key points is formed. . Referring to FIG. 3 , in a specific example of the present invention, a virtual stomach environment is taken as an example for a specific introduction. The key regions of the stomach include: the cardia, fundus, lesser curvature, greater curvature, gastric angle, pylorus and Pyloric sinus area, after the capsule endoscope quickly traverses the working area, the working area composed of curved surfaces can be drawn. Among them, the more sampling points in each key area, the smoother the surface of the work area, and accordingly, the amount of calculation will increase. Further, the coordinates of several working points are acquired in the key area of each stomach, and are connected by straight lines in sequence to form the working area.
本发明具体示例中,可通过引申公开号为:CN110335318A,发明名称为“一种基于摄像系统的消化道内物体测量方法”的中国专利申请,或引申公开号为:CN110327046A,发明名称为“一种基于摄像系统的消化道内物体测量方法”的中国专利申请,可以粗略 估计出每个关键区域中某个工作点的坐标,并在此之后将获取的坐标进行直线连接形成本发明步骤所述的工作区域。In a specific example of the present invention, the Chinese patent application with the extension publication number: CN110335318A, the invention name is "a method for measuring objects in the digestive tract based on a camera system", or the extension publication number: CN110327046A, the invention name is "a kind of The Chinese patent application of "Method for Measuring Objects in Digestive Tract Based on Camera System" can roughly estimate the coordinates of a certain working point in each key area, and then connect the obtained coordinates in a straight line to form the work described in the steps of the present invention. area.
当工作区域确定后,将工作区域划分为多个子工作区,较佳的,以取子工作区最少的划分方式为最佳划分方式。具体的,任意穿过任一子工作区的直线,与当前子工作区最多具有两个交点,即每一子工作区均为凸曲面结构。结合图4所示,本发明具体示例中,将任一面均向外部凸出的子工作区定义为凸曲面的子工作区。After the work area is determined, the work area is divided into a plurality of sub-work areas. Preferably, the best division method is to take the division method with the fewest sub-work areas. Specifically, any straight line passing through any sub-working area has at most two intersection points with the current sub-working area, that is, each sub-working area is a convex surface structure. With reference to FIG. 4 , in the specific example of the present invention, a sub-working area with any surface protruding to the outside is defined as a sub-working area of a convex curved surface.
进一步的,在工作区域确定后,在与工作区域相同的空间坐标系下,为每一子工作区对应建立一虚拟定位区域。较佳的,多个虚拟定位区域的形状相同。Further, after the working area is determined, under the same spatial coordinate system as the working area, a virtual positioning area is correspondingly established for each sub-working area. Preferably, the shapes of the plurality of virtual positioning areas are the same.
本发明具体示例中,配置所述虚拟定位区域为球形,为了便于示出,图3示例中仅显示一个截面,这里,每一虚拟定位区域均包覆其所对应子工作区。In the specific example of the present invention, the virtual positioning area is configured as a sphere. For convenience of illustration, only one section is shown in the example of FIG. 3 . Here, each virtual positioning area covers its corresponding sub-working area.
对于步骤S2,对所述虚拟定位区域进行离散化处理,以将虚拟定位区域划分为相邻、且大小相同的多个体素。本发明具体示例中,配置每一体素为正立方体,且其边长的范围∈[1mm,5mm]。相应的,每一体素具有唯一标识和坐标,所述标识例如为编号。所述坐标可以为每个体素的固定位置坐标值,例如:其中一个边角坐标值。本发明具体示例中,以每一体素的中心点坐标值作为当前体素对应的坐标值。For step S2, the virtual positioning area is discretized, so as to divide the virtual positioning area into multiple adjacent voxels with the same size. In the specific example of the present invention, each voxel is configured as a cube, and the range of its side length is ∈ [1mm, 5mm]. Correspondingly, each voxel has a unique identification and coordinates, and the identification is, for example, a number. The coordinate may be a fixed position coordinate value of each voxel, for example, one of the corner coordinate values. In the specific example of the present invention, the coordinate value of the center point of each voxel is used as the coordinate value corresponding to the current voxel.
可以理解的是,在实际应用中,可以设置一个平台,用户处于平台的监测区域内后,根据用户的位置自动构建虚拟定位区域,且在胶囊内窥镜工作过程中,用户始终处于监测区域内,如此,保证所述虚拟定位区域与所述工作区域处于同一空间坐标系。It can be understood that in practical applications, a platform can be set up, and after the user is in the monitoring area of the platform, a virtual positioning area is automatically constructed according to the user's position, and during the working process of the capsule endoscope, the user is always in the monitoring area. , in this way, it is ensured that the virtual positioning area and the working area are in the same space coordinate system.
对于步骤S3,在子工作区和其所对应的虚拟定位区域确定后,驱动所述胶囊内窥镜进入所述工作区域后,即按照预定的频次记录每一工作点,且根据具体需求,可以选择性记录在每一工作点拍摄的图像、每一工作点的空间坐标值P(x,y,z)和视野朝向M。这里的视野朝向为胶囊内窥镜的姿态,例如:欧拉角(yaw,pitch,roll),也可以是四元素或朝向的向量坐标。通过视野朝向,可以获知在当前坐标点下,胶囊内窥镜朝M方向拍摄的视野,该视野朝向为以当前坐标点为起始的圆锥状,其向量方向为
Figure PCTCN2022080076-appb-000001
亦即圆锥的轴线延长方向。现有技术中,通过胶囊内窥镜拍摄图像、对其位置坐标进行定位,以及记录器视野朝向等步骤均为现有技术,在此不做进一步的赘述。
For step S3, after the sub-working area and its corresponding virtual positioning area are determined, after driving the capsule endoscope into the working area, each working point is recorded according to a predetermined frequency, and according to specific requirements, you can Selectively record the image taken at each work point, the spatial coordinate value P(x, y, z) of each work point, and the view direction M. The field of view orientation here is the posture of the capsule endoscope, such as Euler angles (yaw, pitch, roll), or it can be a four-element or vector coordinate of orientation. Through the field of view orientation, you can know the field of view captured by the capsule endoscope in the M direction at the current coordinate point. The field of view is oriented in a cone shape starting from the current coordinate point, and its vector direction is
Figure PCTCN2022080076-appb-000001
That is, the extension direction of the axis of the cone. In the prior art, the steps of capturing an image through a capsule endoscope, locating its position coordinates, and the direction of the recorder's field of view are all steps in the prior art, and will not be further described here.
本发明较佳实施方式中,步骤S3还包括:对每一工作点获取的图像进行评分,若当前工作点对应获取的图像的评分不小于预设分值,则同步执行步骤A,若当前工作点对应获取的图像的评分小于预设分值,则对当前工作点跳过执行步骤A。In a preferred embodiment of the present invention, step S3 further includes: scoring the images obtained at each work point, and if the score of the images obtained corresponding to the current work point is not less than the preset score, then step A is performed synchronously. If the score of the acquired image corresponding to the point is less than the preset score, then step A is skipped for the current work point.
对图像进行评分可采用多种方式,其为现有技术。例如:授权公告号CN111932532B,发明名称为“一种胶囊内窥镜无参考图像评价方法、电子设备及介质”的中国专利被引 申在本申请中。其中,本发明的评分可以为被引申专利的图像质量评价分值和/或图像内容评价分值和/或综合分值,在此不做赘述。Scoring images can be done in a number of ways, which are known in the art. For example: Authorized Announcement No. CN111932532B, the Chinese patent titled "A Method for Evaluation of Capsule Endoscope Without Reference Image, Electronic Device and Medium" is cited in this application. The score of the present invention may be the image quality evaluation score and/or the image content evaluation score and/or the comprehensive score of the extended patent, which will not be repeated here.
较佳的,在到达每一工作点时,同步执行步骤A以对体素标注点亮标识,分别对于每一虚拟定位区域,当标注点亮标识的体素,在当前虚拟定位区域的占比不小于预设比例阈值时,不再同步执行步骤A。通过标注点亮标识的占比,可以确定胶囊内窥镜检测完备性,其占比越高,说明胶囊检测工作区域更全面。Preferably, when each working point is reached, step A is performed synchronously to mark the voxel with a lighted mark. For each virtual positioning area, when the voxel with the lighted mark is marked, the proportion of the voxel in the current virtual positioning area. When it is not less than the preset ratio threshold, step A is no longer performed synchronously. By marking the proportion of the lit logo, the completeness of capsule endoscopy detection can be determined. The higher the proportion, the more comprehensive the capsule detection work area.
对于步骤A,具体的,初始状态下,每一体素点都默认为未标注点亮标识,所述点亮标识为一种通用标记,标识通过步骤A后,对体素点进行标识,其标识方式具有多种。例如:为相应的体素点标识同一种代码,相同的颜色标识等。通过具体的运算后,不同的体素点被依次点亮,进而通过标注点亮标识的体素占比确定工作区域的检测进度。当然,在本发明其他实施方式中,也可以在初始状态下将体素全部点亮,并按照步骤A的顺序依次熄灭每一体素,在此不做赘述。For step A, specifically, in the initial state, each voxel point is by default an unmarked lighted mark, and the lighted mark is a general mark. After the mark passes through step A, the voxel point is marked, and its mark There are many ways. For example: identify the same code, the same color, etc. for the corresponding voxel points. After specific operations, different voxel points are illuminated in sequence, and then the detection progress of the working area is determined by the proportion of voxels marked with the illuminated logo. Of course, in other embodiments of the present invention, all voxels may be turned on in an initial state, and each voxel may be turned off in sequence in the order of step A, which will not be repeated here.
需要说明的是,由于每一子工作区域均为凸曲面。如此,以当前子工作区域任一工作点为拍摄角度,其视野范围内不存在遮挡,从而,以该工作点为拍摄角度所形成的拍摄视野范围,其内部的体素均可以被完整拍到。It should be noted that each sub-working area is a convex surface. In this way, taking any working point in the current sub-working area as the shooting angle, there is no occlusion in its field of view, so that the shooting field of view formed by taking this working point as the shooting angle, all the voxels inside can be completely photographed .
结合图3所示,工作区域被分割为两个子工作区域,两个子工作区域分别被较大的虚拟定位区域X1,和较小的虚拟定位区域X2包覆。对于步骤A,对于每一工作点,根据其对应的视野朝向可以计算其圆锥台区域。相应的,该圆锥台区域和球状的所述虚拟定位区域具有一交集区域。以坐标点P1,其视野朝向M为例,其交集区域为A1,相应的,当胶囊内窥镜处于坐标点P1时,交集区域A1内的体素全部被标注点亮标识。As shown in FIG. 3 , the working area is divided into two sub-working areas, and the two sub-working areas are respectively covered by a larger virtual positioning area X1 and a smaller virtual positioning area X2. For step A, for each working point, its truncated cone area can be calculated according to its corresponding field of view orientation. Correspondingly, the frustum region and the spherical virtual positioning region have an intersection region. Take the coordinate point P1, whose field of view faces M as an example, and the intersection area is A1. Correspondingly, when the capsule endoscope is at the coordinate point P1, all voxels in the intersection area A1 are marked with lit marks.
较佳的,若任一工作点下,胶囊内窥镜当前处于的所述虚拟定位区域不唯一,则将体素点未全部点亮、且体积最小的虚拟定位区域,默认作为当前工作点对应的所述虚拟定位区域Preferably, if the virtual positioning area where the capsule endoscope is currently located at any working point is not unique, the virtual positioning area where the voxel points are not all lit and the volume is the smallest is set as the corresponding current working point by default. the virtual positioning area of
为了避免子工作区域划分时,因为误差所导致的某些子工作区域为非凸曲面结构,本发明第二较佳实施方式中,执行步骤A时,对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识包括:在所述交集区域内,获取当前工作点与未标注点亮标识的每一体素的视线向量,同时,按照所述交集区域的获取顺序、依次将每一体素对应的视线向量归并到同一向量集;遍历所述向量集,若任一所述向量集的视线向量的数量为至少2个,且存在两个视线向量的夹角大于预设夹角阈值时,对当前向量集对应的体素标注点亮标识。In order to avoid that some sub-working regions are non-convex surface structures due to errors when the sub-working regions are divided, in the second preferred embodiment of the present invention, when step A is performed, the sub-working regions that are in the intersection region and are not marked Marking the lighting mark on the voxel points with the lighting mark includes: in the intersection area, obtaining the line of sight vector of the current working point and each voxel that is not marked with the lighting mark; Merge the line-of-sight vectors corresponding to each voxel into the same vector set; traverse the vector set, if the number of line-of-sight vectors in any of the vector sets is at least 2, and the included angle between the two line-of-sight vectors is greater than the preset folder When the angle threshold is set, the voxel corresponding to the current vector set is marked with a lighted mark.
较佳的,第二较佳实施方式实现步骤A时,所述方法还包括:若两个定位点之间的 距离小于预设距离阈值,且两个定位点的视野朝向之间的夹角小于预设夹角阈值,则在遍历当前两个定位点的视野范围内相交的向量集时,省略视野相交范围内的每一体素到两个定位点所对应的两个视线向量之间夹角的计算。两个定位点偏差较小时,其交集区域可能会近似重合,此时,大概率不会对其交集区域内的体素点标注点亮标识。如此,通过增加该步骤,可以保证计算结果准确性的前提下,降低计算量。Preferably, when the second preferred embodiment implements step A, the method further includes: if the distance between the two positioning points is less than a preset distance threshold, and the angle between the viewing directions of the two positioning points is less than Preset the included angle threshold, when traversing the vector set intersecting within the field of view of the current two positioning points, omit the angle between each voxel within the intersecting range of the field of view and the two line-of-sight vectors corresponding to the two positioning points. calculate. When the deviation of the two positioning points is small, the intersection area may be approximately coincident. At this time, the voxel points in the intersection area are likely not to be marked with lit marks. In this way, by adding this step, the calculation amount can be reduced on the premise of ensuring the accuracy of the calculation result.
通常情况下,该处所述的两个定位点通常为处于同一检测区域内、且顺序获得的两个坐标点,在此不做赘述。Under normal circumstances, the two positioning points described here are usually two coordinate points that are located in the same detection area and are obtained in sequence, and details are not described here.
如上步骤A的操作,会依次标注点亮虚拟定位区域的每一体素点,理想状态下,当胶囊内窥镜结束工作时,虚拟定位区域的每一体素点均被点亮,但实际操作中,多种因素干扰会导致误差出现。因此,本发明设定一预设比例阈值,当标注点亮标识的体素在虚拟定位区域的占比不小于预设比例阈值时,即表示胶囊内窥镜监测的范围符合标准。如此,通过对虚拟定位区域的体素标注点亮标识,来协助胶囊内窥镜的完备性自检。As in step A above, each voxel point in the virtual positioning area will be marked in turn. Ideally, when the capsule endoscope finishes working, each voxel point in the virtual positioning area will be lit up, but in actual operation , the interference of various factors will lead to errors. Therefore, the present invention sets a preset ratio threshold. When the proportion of the voxels marked with the lit logo in the virtual positioning area is not less than the preset ratio threshold, it means that the monitoring range of the capsule endoscope complies with the standard. In this way, the completeness self-check of the capsule endoscope can be assisted by marking the voxels in the virtual positioning area with lit signs.
进一步的,将检测结果可视化,用户通过观察在虚拟定位区域标注的点亮标识,可辅助校验胶囊内窥镜的检测区域,在此不做赘述。Further, the detection result is visualized, and the user can assist in verifying the detection area of the capsule endoscope by observing the lighted mark marked in the virtual positioning area, which will not be repeated here.
较佳的,所述方法还包括:实时判断标注点亮标识的体素点在虚拟定位区域的占比是否不小于预设比例阈值,若是,驱动胶囊内窥镜退出工作模式;若否,驱动胶囊内窥镜继续工作模式。Preferably, the method further includes: judging in real time whether the proportion of the voxel points marked with the lit logo in the virtual positioning area is not less than a preset proportion threshold, and if so, driving the capsule endoscope to exit the working mode; if not, driving the capsule endoscope. The capsule endoscope continues working mode.
较佳的,所述方法还包括:胶囊内窥镜在工作区域运行预设工作时长时,判断标注点亮标识的体素点在虚拟定位区域的占比是否不小于预设比例阈值,若是,驱动胶囊内窥镜退出工作模式;若否,驱动胶囊内窥镜继续工作模式。通过标注点亮标识的体素点在虚拟定位区域的占比判断是否结束工作模式,可以多视角观察工作区域,进而在多视角的判断标准下增加相同区域的图像拍摄数量,不仅保证了拍摄的完备性,还可以在图像后期应用中,多角度观察同一个区域,达到更好观察效果,提高检出率。Preferably, the method further includes: when the capsule endoscope runs for a preset working time in the working area, judging whether the proportion of the voxel points marked with the lit logo in the virtual positioning area is not less than a preset proportion threshold, and if so, Drive the capsule endoscope to exit the working mode; if not, drive the capsule endoscope to continue the working mode. By marking the proportion of the voxel points with the lit logo in the virtual positioning area to determine whether to end the working mode, the working area can be observed from multiple perspectives, and the number of images taken in the same area can be increased under the multi-perspective judgment criteria, which not only ensures the shooting quality Completeness, you can also observe the same area from multiple angles in the post-image application to achieve a better observation effect and improve the detection rate.
进一步的,本发明一实施方式提供一种电子设备,包括存储器和处理器,所述存储器存储有可在所述处理器上运行的计算机程序,所述处理器执行所述程序时,实现如上所述胶囊内窥镜的分区完备性自检方法中的步骤。Further, an embodiment of the present invention provides an electronic device, including a memory and a processor, the memory stores a computer program that can run on the processor, and when the processor executes the program, the above-mentioned Describe the steps in the self-checking method of partition completeness of capsule endoscope.
进一步的,本发明一实施方式提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现如上所述胶囊内窥镜的分区完备性自检方法中的步骤。Further, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, realizes the above-mentioned partition completeness self-checking method of a capsule endoscope. A step of.
综上所述,本发明的胶囊内窥镜的分区完备性自检方法、设备及可读存储介质,将工作区域划分为凸曲面构成的子工作区,对应每个子工作区建立与其处于同一空间坐标 系下的虚拟定位区域,并在子工作区与虚拟定位区域相交时进行标注点亮标识,可以实现胶囊内窥镜的完备性自检,提高检测概率。同时,还可以实现检测效果可视化,提高胶囊内窥镜操作的便利性。To sum up, the self-checking method, device and readable storage medium of the partition completeness of the capsule endoscope of the present invention divide the working area into sub-working areas composed of convex curved surfaces, and each sub-working area is established in the same space as the sub-working area. The virtual positioning area under the coordinate system is marked and illuminated when the sub-working area intersects with the virtual positioning area, which can realize the completeness self-check of the capsule endoscope and improve the detection probability. At the same time, the visualization of the detection effect can also be realized, and the convenience of the operation of the capsule endoscope can be improved.
应当理解,虽然本说明书按照实施方式加以描述,但并非每个实施方式仅包含一个独立的技术方案,说明书的这种叙述方式仅仅是为清楚起见,本领域技术人员应当将说明书作为一个整体,各实施方式中的技术方案也可以经适当组合,形成本领域技术人员可以理解的其他实施方式。It should be understood that although this specification is described in terms of embodiments, not every embodiment only includes an independent technical solution, and this description in the specification is only for the sake of clarity, and those skilled in the art should take the specification as a whole, and each The technical solutions in the embodiments can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.
上文所列出的一系列的详细说明仅仅是针对本发明的可行性实施方式的具体说明,它们并非用以限制本发明的保护范围,凡未脱离本发明技艺精神所作的等效实施方式或变更均应包含在本发明的保护范围之内。The series of detailed descriptions listed above are only specific descriptions for the feasible embodiments of the present invention, and they are not used to limit the protection scope of the present invention. Changes should all be included within the protection scope of the present invention.

Claims (10)

  1. 一种胶囊内窥镜的分区完备性自检方法,其特征在于,所述方法包括:A self-checking method for partition completeness of a capsule endoscope, characterized in that the method comprises:
    获取胶囊内窥镜的工作区域,将所述工作区域划分为多个子工作区,任意穿过任一子工作区的直线,与当前子工作区最多具有两个交点;Obtaining the working area of the capsule endoscope, dividing the working area into a plurality of sub-working areas, and a straight line passing through any sub-working area arbitrarily has at most two intersections with the current sub-working area;
    为每一子工作区对应建立一虚拟定位区域,所述虚拟定位区域与所述工作区域处于同一空间坐标系,所述虚拟定位区域完全包覆所述工作区域;Correspondingly establish a virtual positioning area for each sub-working area, the virtual positioning area and the working area are in the same spatial coordinate system, and the virtual positioning area completely covers the working area;
    将每一所述虚拟定位区域划分为相邻、且大小相同的多个体素,每一所述体素具有唯一标识和坐标;dividing each of the virtual positioning areas into a plurality of adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates;
    驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对每一虚拟定位区域内的体素标注点亮标识,分别对于每一虚拟定位区域,当标注点亮标识的体素在当前虚拟定位区域的占比不小于预设比例阈值时,不再同步执行步骤A;Drive the capsule endoscope to move in the working area, and sequentially record the images captured by the capsule endoscope when it reaches each working point according to a predetermined frequency, and perform step A synchronously to scan the body in each virtual positioning area. The voxel is marked with a lighting mark, and for each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously;
    其中,初始状态下,每一体素点均未标注点亮标识;Among them, in the initial state, each voxel point is not marked with a lighted mark;
    步骤A包括:Step A includes:
    顺序记录每一工作点在所述空间坐标系中的位置及视野朝向;Sequentially record the position and view orientation of each working point in the space coordinate system;
    依次在每一工作点,依据当前工作点的位置及视野朝向确认当前工作点下,胶囊内窥镜的视野与其当前处于的所述虚拟定位区域的交集区域;At each work point in turn, confirm the intersection area of the field of view of the capsule endoscope and the virtual positioning area currently located at the current work point according to the position of the current work point and the direction of the field of view;
    对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识。Marking a lighting mark on the voxel points that are in the intersection area and are not marked with a lighting mark.
  2. 根据权利要求1所述的胶囊内窥镜的分区完备性自检方法,其特征在于,驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对体素标注点亮标识包括:The self-checking method for partition completeness of a capsule endoscope according to claim 1, wherein the capsule endoscope is driven to move in the working area, and the arrival of the capsule endoscope is recorded in sequence according to a predetermined frequency. An image taken at a working point, and step A is performed synchronously to label the voxel with the lit logo, including:
    对每一工作点获取的图像进行评分,若当前工作点对应获取的图像的评分不小于预设分值,则同步执行步骤A,若当前工作点对应获取的图像的评分小于预设分值,则对当前工作点跳过执行步骤A。Score the images obtained at each work point. If the score of the image obtained corresponding to the current work point is not less than the preset score, step A is performed synchronously. If the score of the image obtained corresponding to the current work point is less than the preset score, Then, step A is skipped for the current working point.
  3. 根据权利要求1所述的胶囊内窥镜的分区完备性自检方法,其特征在于,执行步骤A时,所述方法还包括:The self-checking method for partition completeness of a capsule endoscope according to claim 1, wherein when step A is performed, the method further comprises:
    若任一工作点下,胶囊内窥镜当前处于的所述虚拟定位区域不唯一,则将体素点未全部点亮、且体积最小的虚拟定位区域默认作为当前工作点对应的所述虚拟定位区域。If at any working point, the virtual positioning area where the capsule endoscope is currently located is not unique, the virtual positioning area with not all the voxels lit and the smallest volume will be defaulted as the virtual positioning corresponding to the current working point area.
  4. 根据权利要求1所述的胶囊内窥镜的分区完备性自检方法,其特征在于,执行步骤A时,对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识包括:The self-checking method for partition completeness of a capsule endoscope according to claim 1, characterized in that, when step A is performed, a lighting mark is marked on the voxel points in the intersection area and not marked with a lighting mark include:
    在所述交集区域内,获取当前工作点与未标注点亮标识的每一体素的视线向量,同时,按照所述交集区域的获取顺序、依次将每一体素对应的视线向量归并到同一向量集;In the intersection area, obtain the line of sight vector of the current working point and each voxel that is not marked with a lighted mark, and at the same time, according to the acquisition order of the intersection area, the line of sight vector corresponding to each voxel is merged into the same vector set. ;
    遍历所述向量集,若任一所述向量集的视线向量的数量为至少2个,且存在两个视线向量的夹角大于预设夹角阈值时,对当前向量集对应的体素标注点亮标识。Traverse the vector set, if the number of sight vectors in any one of the vector sets is at least 2, and the included angle between the two sight vectors is greater than the preset angle threshold, mark the voxel corresponding to the current vector set. Bright logo.
  5. 根据权利要求4所述的胶囊内窥镜的分区完备性自检方法,其特征在于,执行步骤A时,所述方法还包括:The self-checking method for partition completeness of a capsule endoscope according to claim 4, wherein when step A is performed, the method further comprises:
    若两个定位点之间的距离小于预设距离阈值,且两个定位点的视野朝向之间的夹角小于预设夹角阈值,则在遍历当前两个定位点的视野范围内相交的向量集时,省略视野相交范围内的每一体素到两个定位点所对应的两个视线向量之间夹角的计算。If the distance between the two positioning points is less than the preset distance threshold, and the angle between the viewing directions of the two positioning points is smaller than the preset angle threshold, then the vector intersecting within the field of view of the two current positioning points is traversed. When set, the calculation of the angle between each voxel in the intersecting range of the visual field and the two line-of-sight vectors corresponding to the two positioning points is omitted.
  6. 根据权利要求1所述的胶囊内窥镜的分区完备性自检方法,其特征在于,所述方法还包括:The self-checking method for partition completeness of a capsule endoscope according to claim 1, wherein the method further comprises:
    实时判断标注点亮标识的体素点在每一虚拟定位区域的占比是否均不小于预设比例阈值,judging in real time whether the proportion of the voxel points marked with the lit logo in each virtual positioning area is not less than the preset proportion threshold,
    若是,驱动胶囊内窥镜退出工作模式;If so, drive the capsule endoscope to exit the working mode;
    若否,驱动胶囊内窥镜继续工作模式。If not, drive the capsule endoscope to continue working mode.
  7. 根据权利要求1所述的胶囊内窥镜的分区完备性自检方法,其特征在于,所述方法还包括:The self-checking method for partition completeness of a capsule endoscope according to claim 1, wherein the method further comprises:
    胶囊内窥镜在工作区域运行预设工作时长时,判断标注点亮标识的体素点在每一虚拟定位区域的占比是否均不小于预设比例阈值,When the capsule endoscope runs for a preset working time in the working area, it is judged whether the proportion of the voxel points marked with the lit logo in each virtual positioning area is not less than the preset proportion threshold, and
    若是,驱动胶囊内窥镜退出工作模式;If so, drive the capsule endoscope to exit the working mode;
    若否,驱动胶囊内窥镜继续工作模式。If not, drive the capsule endoscope to continue working mode.
  8. 根据权利要求1所述的胶囊内窥镜的分区完备性自检方法,其特征在于,配置每一所述虚拟定位区域均为球形。The self-checking method for partition completeness of a capsule endoscope according to claim 1, wherein each of the virtual positioning regions is configured to be spherical.
  9. 一种电子设备,包括存储器和处理器,所述存储器存储有可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现一种胶囊内窥镜的分区完备性自检方法中的步骤,所述方法包括:An electronic device, comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, wherein the processor implements a partition of a capsule endoscope when the processor executes the program Steps in a completeness self-checking method, the method comprising:
    获取胶囊内窥镜的工作区域,将所述工作区域划分为多个子工作区,任意穿过任一子工作区的直线,与当前子工作区最多具有两个交点;Obtaining the working area of the capsule endoscope, dividing the working area into a plurality of sub-working areas, and a straight line passing through any sub-working area arbitrarily has at most two intersections with the current sub-working area;
    为每一子工作区对应建立一虚拟定位区域,所述虚拟定位区域与所述工作区域处于同一空间坐标系,所述虚拟定位区域完全包覆所述工作区域;Correspondingly establish a virtual positioning area for each sub-working area, the virtual positioning area and the working area are in the same spatial coordinate system, and the virtual positioning area completely covers the working area;
    将每一所述虚拟定位区域划分为相邻、且大小相同的多个体素,每一所述体素具有 唯一标识和坐标;Dividing each of the virtual positioning areas into multiple adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates;
    驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对每一虚拟定位区域内的体素标注点亮标识,分别对于每一虚拟定位区域,当标注点亮标识的体素在当前虚拟定位区域的占比不小于预设比例阈值时,不再同步执行步骤A;Drive the capsule endoscope to move in the working area, and sequentially record the images captured by the capsule endoscope when it reaches each working point according to a predetermined frequency, and perform step A synchronously to scan the body in each virtual positioning area. The voxel is marked with a lighting mark, and for each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously;
    其中,初始状态下,每一体素点均未标注点亮标识;Among them, in the initial state, each voxel point is not marked with a lighted mark;
    步骤A包括:Step A includes:
    顺序记录每一工作点在所述空间坐标系中的位置及视野朝向;Sequentially record the position and view orientation of each working point in the space coordinate system;
    依次在每一工作点,依据当前工作点的位置及视野朝向确认当前工作点下,胶囊内窥镜的视野与其当前处于的所述虚拟定位区域的交集区域;At each work point in turn, confirm the intersection area of the field of view of the capsule endoscope and the virtual positioning area currently located at the current work point according to the position of the current work point and the direction of the field of view;
    对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识。Marking a lighting mark on the voxel points that are in the intersection area and are not marked with a lighting mark.
  10. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现一种胶囊内窥镜的分区完备性自检方法中的步骤,所述方法包括:A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps in a self-checking method for partition integrity of a capsule endoscope are implemented, the method comprising: :
    获取胶囊内窥镜的工作区域,将所述工作区域划分为多个子工作区,任意穿过任一子工作区的直线,与当前子工作区最多具有两个交点;Obtaining the working area of the capsule endoscope, dividing the working area into a plurality of sub-working areas, and a straight line passing through any sub-working area arbitrarily has at most two intersections with the current sub-working area;
    为每一子工作区对应建立一虚拟定位区域,所述虚拟定位区域与所述工作区域处于同一空间坐标系,所述虚拟定位区域完全包覆所述工作区域;Correspondingly establish a virtual positioning area for each sub-working area, the virtual positioning area and the working area are in the same spatial coordinate system, and the virtual positioning area completely covers the working area;
    将每一所述虚拟定位区域划分为相邻、且大小相同的多个体素,每一所述体素具有唯一标识和坐标;dividing each of the virtual positioning areas into a plurality of adjacent voxels with the same size, and each of the voxels has a unique identifier and coordinates;
    驱动所述胶囊内窥镜在所述工作区域内运动,并按照预定频率依次记录胶囊内窥镜到达每一工作点时拍摄的图像,并同步执行步骤A以对每一虚拟定位区域内的体素标注点亮标识,分别对于每一虚拟定位区域,当标注点亮标识的体素在当前虚拟定位区域的占比不小于预设比例阈值时,不再同步执行步骤A;Drive the capsule endoscope to move in the working area, and sequentially record the images captured by the capsule endoscope when it reaches each working point according to a predetermined frequency, and perform step A synchronously to scan the body in each virtual positioning area. The voxel is marked with a lighting mark, and for each virtual positioning area, when the proportion of the voxels marked with the lighting mark in the current virtual positioning area is not less than the preset ratio threshold, step A is no longer performed synchronously;
    其中,初始状态下,每一体素点均未标注点亮标识;Among them, in the initial state, each voxel point is not marked with a lighted mark;
    步骤A包括:Step A includes:
    顺序记录每一工作点在所述空间坐标系中的位置及视野朝向;Sequentially record the position and view orientation of each working point in the space coordinate system;
    依次在每一工作点,依据当前工作点的位置及视野朝向确认当前工作点下,胶囊内窥镜的视野与其当前处于的所述虚拟定位区域的交集区域;At each work point in turn, confirm the intersection area of the field of view of the capsule endoscope and the virtual positioning area currently located at the current work point according to the position of the current work point and the direction of the field of view;
    对处于所述交集区域、且未被标注点亮标识的体素点标注点亮标识。Marking a lighting mark on the voxel points that are in the intersection area and are not marked with a lighting mark.
PCT/CN2022/080076 2021-03-17 2022-03-10 Area-by-area completeness self-checking method of capsule endoscope, electronic device, and readable storage medium WO2022194015A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110284699.9A CN113017544B (en) 2021-03-17 2021-03-17 Sectional completeness self-checking method and device for capsule endoscope and readable storage medium
CN202110284699.9 2021-03-17

Publications (1)

Publication Number Publication Date
WO2022194015A1 true WO2022194015A1 (en) 2022-09-22

Family

ID=76470911

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/080076 WO2022194015A1 (en) 2021-03-17 2022-03-10 Area-by-area completeness self-checking method of capsule endoscope, electronic device, and readable storage medium

Country Status (2)

Country Link
CN (1) CN113017544B (en)
WO (1) WO2022194015A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112998630B (en) * 2021-03-17 2022-07-29 安翰科技(武汉)股份有限公司 Self-checking method for completeness of capsule endoscope, electronic equipment and readable storage medium
CN113017544B (en) * 2021-03-17 2022-07-29 安翰科技(武汉)股份有限公司 Sectional completeness self-checking method and device for capsule endoscope and readable storage medium
CN113951808A (en) * 2021-12-10 2022-01-21 广州思德医疗科技有限公司 Method, device and system for acquiring stomach image of non-magnetic control capsule endoscope

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080117210A1 (en) * 2006-11-22 2008-05-22 Barco N.V. Virtual endoscopy
WO2012163779A1 (en) * 2011-06-03 2012-12-06 Siemens Aktiengesellschaft Method and device for carrying out an examination of a body cavity of a patient
CN109907720A (en) * 2019-04-12 2019-06-21 重庆金山医疗器械有限公司 Video image dendoscope auxiliary examination method and video image dendoscope control system
CN110136808A (en) * 2019-05-23 2019-08-16 安翰科技(武汉)股份有限公司 A kind of filming apparatus auxiliary display system
CN112998630A (en) * 2021-03-17 2021-06-22 安翰科技(武汉)股份有限公司 Self-checking method for completeness of capsule endoscope, electronic equipment and readable storage medium
CN113017544A (en) * 2021-03-17 2021-06-25 安翰科技(武汉)股份有限公司 Partition completeness self-checking method and device for capsule endoscope and readable storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7194117B2 (en) * 1999-06-29 2007-03-20 The Research Foundation Of State University Of New York System and method for performing a three-dimensional virtual examination of objects, such as internal organs
US7447342B2 (en) * 2003-09-22 2008-11-04 Siemens Medical Solutions Usa, Inc. Method and system for using cutting planes for colon polyp detection
DE102010009884A1 (en) * 2010-03-02 2011-09-08 Friedrich-Alexander-Universität Erlangen-Nürnberg Method and device for acquiring information about the three-dimensional structure of the inner surface of a body cavity
CN110335318B (en) * 2019-04-28 2022-02-11 安翰科技(武汉)股份有限公司 Method for measuring object in digestive tract based on camera system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080117210A1 (en) * 2006-11-22 2008-05-22 Barco N.V. Virtual endoscopy
WO2012163779A1 (en) * 2011-06-03 2012-12-06 Siemens Aktiengesellschaft Method and device for carrying out an examination of a body cavity of a patient
CN109907720A (en) * 2019-04-12 2019-06-21 重庆金山医疗器械有限公司 Video image dendoscope auxiliary examination method and video image dendoscope control system
CN110136808A (en) * 2019-05-23 2019-08-16 安翰科技(武汉)股份有限公司 A kind of filming apparatus auxiliary display system
CN112998630A (en) * 2021-03-17 2021-06-22 安翰科技(武汉)股份有限公司 Self-checking method for completeness of capsule endoscope, electronic equipment and readable storage medium
CN113017544A (en) * 2021-03-17 2021-06-25 安翰科技(武汉)股份有限公司 Partition completeness self-checking method and device for capsule endoscope and readable storage medium

Also Published As

Publication number Publication date
CN113017544A (en) 2021-06-25
CN113017544B (en) 2022-07-29

Similar Documents

Publication Publication Date Title
WO2022194015A1 (en) Area-by-area completeness self-checking method of capsule endoscope, electronic device, and readable storage medium
WO2022194014A1 (en) Completeness self-checking method of capsule endoscope, electronic device, and readable storage medium
US9460536B2 (en) Endoscope system and method for operating endoscope system that display an organ model image to which an endoscopic image is pasted
JP5771757B2 (en) Endoscope system and method for operating endoscope system
US7922652B2 (en) Endoscope system
US9521944B2 (en) Endoscope system for displaying an organ model image to which an endoscope image is pasted
JP6049202B2 (en) Image processing apparatus, method, and program
WO2022194126A1 (en) Method for building image reading model based on capsule endoscope, device, and medium
CN111544037A (en) Ultrasonic positioning method and system based on binocular vision
WO2016076262A1 (en) Medical device
US20230353879A1 (en) Program, information processing method, and endoscope system
WO2020231157A1 (en) Augmented reality colonofiberscope system and monitoring method using same
Helferty et al. System for Live Virtual-Endoscopic Guidance of Bronchoscopy.
CN115024805A (en) Method, system and storage medium for assisting puncture of endoscopic surgery
TWM609723U (en) Throat foreign object recognition device
WO2007102296A1 (en) Medical image processing device and medical image processing method
JP4776919B2 (en) Medical image processing device
US11601732B2 (en) Display system for capsule endoscopic image and method for generating 3D panoramic view
US20240000299A1 (en) Image processing apparatus, image processing method, and program
WO2024028934A1 (en) Endoscopy assistance device, endoscopy assistance method, and recording medium
KR20230134765A (en) Method for detecting and displaying gastric lesion using machine learning and device for the same
TWM620109U (en) Aid judgment system
CN116153147A (en) 3D-VR binocular stereoscopic vision image construction method and endoscope operation teaching device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22770370

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22770370

Country of ref document: EP

Kind code of ref document: A1