WO2020135226A1 - Drainage monitoring system and method based on image recognition - Google Patents

Drainage monitoring system and method based on image recognition Download PDF

Info

Publication number
WO2020135226A1
WO2020135226A1 PCT/CN2019/126662 CN2019126662W WO2020135226A1 WO 2020135226 A1 WO2020135226 A1 WO 2020135226A1 CN 2019126662 W CN2019126662 W CN 2019126662W WO 2020135226 A1 WO2020135226 A1 WO 2020135226A1
Authority
WO
WIPO (PCT)
Prior art keywords
drainage
data
monitoring
module
color
Prior art date
Application number
PCT/CN2019/126662
Other languages
French (fr)
Chinese (zh)
Inventor
刘铁楠
吴春涛
艾梦池
Original Assignee
刘铁楠
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 刘铁楠 filed Critical 刘铁楠
Priority to JP2021538480A priority Critical patent/JP7211668B2/en
Publication of WO2020135226A1 publication Critical patent/WO2020135226A1/en
Priority to US17/304,841 priority patent/US20210316060A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M1/00Suction or pumping devices for medical purposes; Devices for carrying-off, for treatment of, or for carrying-over, body-liquids; Drainage systems
    • A61M1/71Suction drainage systems
    • A61M1/73Suction drainage systems comprising sensors or indicators for physical values
    • A61M1/734Visual indicating means for flow
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Hematology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Vascular Medicine (AREA)
  • Veterinary Medicine (AREA)
  • Anesthesiology (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • External Artificial Organs (AREA)
  • Invalid Beds And Related Equipment (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Alarm Systems (AREA)
  • Image Analysis (AREA)

Abstract

Disclosed are a drainage monitoring system and method based on image recognition. According to an exemplary embodiment, the drainage monitoring system comprises: at least one video acquisition device for obtaining video stream data of a drainage liquid; an image processing module, which is connected to the at least one video acquisition device and used for receiving the video stream data and processing the video stream data to obtain drainage data of the drainage liquid; and a monitoring module, which is connected to the image processing module and used for receiving and monitoring the drainage data. Moreover, the monitoring system can further be provided with a central monitoring module for monitoring monitored data of multiple monitoring modules in real time. The drainage monitoring system can centrally monitor multiple drainage data such as the drainage volume, color, turbidity of the drainage liquid, and monitor relevant data and start alarm, so that the work burden of medical staff is effectively reduced, and the medical risks are reduced.

Description

一种基于图像识别的引流监控系统及方法Drainage monitoring system and method based on image recognition 技术领域Technical field
本发明总体上涉及医疗器械领域,更具体地,涉及一种基于图像识别的引流监控系统及方法。The present invention generally relates to the field of medical devices, and more particularly, to a drainage monitoring system and method based on image recognition.
背景技术Background technique
体液引流装置是医疗领域最常见的医疗器械之一,被广泛应用于各大临床科室,现有医用最常用的引流装置主要为引流瓶或者引流袋。在临床的诊治应用过程中,引流装置依靠重力或者负压作用引流,多置于病床底部。The body fluid drainage device is one of the most common medical devices in the medical field and is widely used in major clinical departments. The most commonly used drainage devices for existing medical devices are mainly drainage bottles or drainage bags. In the clinical application of diagnosis and treatment, drainage devices rely on gravity or negative pressure to drain, and are mostly placed at the bottom of the bed.
引流过程中表征病情变化的指标有引流液的引流量、颜色、浑浊度等数据,引流量的多少反映了患者体腔中积水、血脓的积聚程度及症状,引流液的颜色、浑浊度一定程度上则反映了引流部位组织的状况。因当前的医用引流装置一般仍依靠人工查看的方式进行监测,不可实现对引流装置内液体的自动监测,而患者一般需要引流治疗时间长,有时可达数天甚至数周,因此将耗费大量人力,尤其对夜间或者人员缺乏的时候不便于观察监测引流液的引流量、颜色、浑浊度等情况。而且,时常发生患者病情发生恶化而导致引流液短时间突然增多或者性状改变的情况,例如血管破裂导致大出血、引流液中掺杂了异常物而由澄清稀薄变成了浑浊状态,这都需要医护人员及时发现并且进行相应的处理,而常规的人工观察监测模式难以及时发现这种变化,容易延误病情,造成严重后果甚至危及患者生命。The indicators that characterize the changes in the drainage process include the drainage volume, color, and turbidity of the drainage fluid. The amount of drainage volume reflects the accumulation and symptoms of water and blood pus in the body cavity of the patient. The color and turbidity of the drainage fluid must be To a certain extent, it reflects the status of the drainage site tissue. Because the current medical drainage devices generally still rely on manual viewing for monitoring, automatic monitoring of the liquid in the drainage device cannot be achieved, and patients generally require long drainage treatment times, sometimes up to days or even weeks, so it will consume a lot of manpower It is especially inconvenient to observe and monitor the drainage volume, color and turbidity of the drainage fluid at night or when there is a shortage of personnel. Moreover, there are often cases where the patient's condition deteriorates and the drainage fluid suddenly increases or the traits change for a short time. For example, a blood vessel rupture leads to massive bleeding, and the drainage fluid is doped with an abnormal substance, which changes from clarified and thin to turbid, which requires medical care. Personnel find and perform corresponding treatments in time, and the conventional manual observation and monitoring mode is difficult to detect such changes in time, and it is easy to delay the disease, cause serious consequences and even endanger the lives of patients.
有鉴于此,期望提供一种引流监测装置,能同时对包括引流量、流速、引流液的颜色等在内的引流数据进行集中监测,最大限度的降低医疗风险,并做到发现、报警、记录和处理,从而减小了医护人员的工作负担,降低了因人为监测漏洞而可能导致的医疗风险。In view of this, it is desirable to provide a drainage monitoring device that can simultaneously monitor drainage data including drainage flow rate, flow rate, drainage fluid color, etc., to minimize medical risks, and find, alarm, and record And treatment, thereby reducing the workload of medical staff, reducing the medical risks that may be caused by artificial monitoring of loopholes.
发明内容Summary of the invention
为了解决上述技术问题,本发明提供了一种医用引流液的监控系统及方法,其可以实现对引流液的引流量、流速、颜色、浑浊度等引流过程中的重 要信息数据进行统一监控,有效地对相关数据进行收集、记录,并在出现异常时进行报警。In order to solve the above technical problems, the present invention provides a medical drainage liquid monitoring system and method, which can realize the unified monitoring of important information data in the drainage process such as the drainage flow rate, flow rate, color, turbidity, etc. Collect and record the relevant data, and report to the police when an abnormality occurs.
根据本发明的一方面,提供了一种基于图像识别的引流监控系统,包括:至少一个视频采集装置,用于获取引流液的视频流数据;图像处理模块,其与所述至少一个视频采集装置连接,用于接收所述视频流数据并对所述视频流数据进行处理,以获得所述引流液的引流数据;以及监测模块,其与所述图像处理模块相连接,用于接收并监测所述引流数据。According to an aspect of the present invention, there is provided a drainage monitoring system based on image recognition, comprising: at least one video acquisition device for acquiring video stream data of drainage fluid; an image processing module, which is connected to the at least one video acquisition device Connected for receiving the video stream data and processing the video stream data to obtain the drainage data of the drainage liquid; and a monitoring module connected to the image processing module for receiving and monitoring Describe the streaming data.
在一实施例中,所述视频采集装置包括对准引流容器的第一视频采集装置,任选地,还包括对准引流管的第二视频采集装置。In an embodiment, the video capture device includes a first video capture device aligned with the drainage container, and optionally, a second video capture device aligned with the drainage tube.
在一实施例中,所述引流数据包括引流液的颜色、浑浊度及引流量。In one embodiment, the drainage data includes the color, turbidity and drainage volume of the drainage fluid.
在一实施例中,所述监测模块还配置为基于所述引流液的引流量数据计算流经引流管的引流液的流速。In an embodiment, the monitoring module is further configured to calculate the flow rate of the drainage liquid flowing through the drainage tube based on the drainage flow data of the drainage liquid.
在一实施例中,所述监测模块还配置为基于所述颜色和浑浊度的变化确定引流液的性状改变。In an embodiment, the monitoring module is further configured to determine a change in the properties of the drainage fluid based on the change in color and turbidity.
在一实施例中,所述图像处理模块包括:图像采样模块,用于从所述视频流数据中提取关键帧图像;颜色提取模块,用于对所述关键帧图像进行图像识别,提取所述关键帧图像的色彩信息;浑浊度检测模块,用于对所述关键帧图像进行处理,确定所述引流液的浑浊度信息;引流量读取模块,用于对所述关键帧图像进行图像识别和增强处理,读取所述关键帧图像中的刻度值信息。In an embodiment, the image processing module includes: an image sampling module for extracting a key frame image from the video stream data; a color extraction module for performing image recognition on the key frame image and extracting the Color information of key frame image; turbidity detection module, used to process the key frame image to determine the turbidity information of the drainage fluid; drainage flow reading module, used to perform image recognition on the key frame image And enhanced processing, read the scale value information in the key frame image.
在一实施例中,所述图像采样模块配置为基于所述色彩信息的变化而调整采样率。In an embodiment, the image sampling module is configured to adjust the sampling rate based on changes in the color information.
在一实施例中,所述浑浊度检测模块包括:亮度提取模块,从所述关键帧图像中提取所述图像的亮度值;浑浊度确定模块,基于所述亮度值表征所述引流液的浑浊度信息。In one embodiment, the turbidity detection module includes: a brightness extraction module to extract the brightness value of the image from the key frame image; a turbidity determination module to characterize the turbidity of the drainage fluid based on the brightness value Degrees information.
在一实施例中,所述图像处理模块包括:图像采样模块,用于从所述视频流数据中提取关键帧图像;图像特征提取模块,用于从所述关键帧图像中提取色彩特征及浑浊度特征,其中所述图像特征提取模块为基于神经网络训练获得的模型。In an embodiment, the image processing module includes: an image sampling module for extracting key frame images from the video stream data; and an image feature extraction module for extracting color features and turbidity from the key frame images Degree features, wherein the image feature extraction module is a model obtained based on neural network training.
在一实施例中,所述图像采样模块配置为基于所述色彩特征的变化而调整采样率。In an embodiment, the image sampling module is configured to adjust the sampling rate based on changes in the color characteristics.
在一实施例中,所述监测模块包括:第一数据接收单元,用于接收所述引流液的颜色、浑浊度及引流量数据;数据处理单元,用于基于所述引流量数据计算流经所述引流管的引流液流速,和基于所述颜色数据和浑浊度数据的变化确定引流液的性状改变;第一显示单元,用于对所述颜色、浑浊度、引流量、流速和性状改变中的至少一个进行实时显示;以及第一报警单元,用于在所述引流量、颜色、浑浊度、引流量、流速和性状改变中的至少一个超过预定阈值时,发出警报信号。In an embodiment, the monitoring module includes: a first data receiving unit for receiving color, turbidity and drainage flow data of the drainage liquid; a data processing unit for calculating flow through based on the drainage flow data The flow rate of the drainage liquid of the drainage tube, and determining the property change of the drainage liquid based on the change of the color data and the turbidity data; the first display unit is used to change the color, turbidity, drainage flow rate, flow rate and properties At least one of them is displayed in real time; and a first alarm unit is used to issue an alarm signal when at least one of the drainage volume, color, turbidity, drainage volume, flow rate, and property changes exceeds a predetermined threshold.
在一实施例中,所述引流监控系统还包括:中央监控模块,用于实时监控多个所述监测模块的监测数据。In an embodiment, the drainage monitoring system further includes a central monitoring module for monitoring the monitoring data of a plurality of the monitoring modules in real time.
在一实施例中,所述中央监控模块包括:第二数据接收单元,用于接收多个所述监测模块以有线或无线方式发送的监测数据,所述监测数据包括所述颜色、浑浊度、引流量、流速和性状改变中的至少一个;存储单元,用于存储所述监测数据;以及第二显示单元,用于同时显示多个所述监测模块的监测数据。In an embodiment, the central monitoring module includes: a second data receiving unit configured to receive monitoring data sent by a plurality of the monitoring modules in a wired or wireless manner, the monitoring data including the color, turbidity, At least one of the drainage volume, the flow rate, and the change in the properties; the storage unit for storing the monitoring data; and the second display unit for simultaneously displaying the monitoring data of a plurality of the monitoring modules.
在一实施例中,所述中央监控模块还包括:第二报警单元,用于在多个所述监测模块中的任意一个的监测数据超过预定阈值时,发出警报信号。In an embodiment, the central monitoring module further includes: a second alarm unit, configured to issue an alarm signal when the monitoring data of any one of the plurality of monitoring modules exceeds a predetermined threshold.
在一实施例中,所述中央监控模块还包括:阈值设置单元,用于设置每个监测模块的监测数据的预定阈值。In an embodiment, the central monitoring module further includes: a threshold setting unit for setting a predetermined threshold of the monitoring data of each monitoring module.
本发明的另一方面提供了一种基于图像识别的引流监控方法,包括:获取引流液的视频流数据;对所述视频流数据进行处理,以获得所述引流液的引流数据;以及接收并监测所述引流数据,其中,所述引流数据包括所述引流液的颜色、浑浊度及引流量。Another aspect of the present invention provides a drainage monitoring method based on image recognition, including: acquiring video stream data of drainage fluid; processing the video stream data to obtain drainage data of the drainage fluid; and receiving and Monitoring the drainage data, wherein the drainage data includes the color, turbidity and drainage volume of the drainage liquid.
与现有技术相比,根据本申请实施例的引流监控系统,其能准确监测引流液的颜色及其变化,并基于图像处理实现对引流液的流速、引流量、浑浊度等多种引流数据的监测,做到对上述引流数据的处理、记录和报警,减小了医护人员的工作负担,极大地降低了医疗风险;该监控系统对引流液的液体性质并无要求,对所有的体液均能有较好的响应,精度较高;且监控系统结构简单、便于安装部署,可适用于各种临床场合。Compared with the prior art, the drainage monitoring system according to the embodiment of the present application can accurately monitor the color and change of the drainage liquid, and realizes a variety of drainage data such as the flow rate, drainage volume, and turbidity of the drainage liquid based on image processing Monitoring, to achieve the processing, recording and alarming of the above drainage data, reducing the workload of medical staff and greatly reducing medical risks; the monitoring system does not require the liquid nature of the drainage fluid, and all body fluids are It has better response and higher accuracy; and the monitoring system has a simple structure, is easy to install and deploy, and can be applied to various clinical occasions.
附图说明BRIEF DESCRIPTION
通过结合附图对本申请实施例进行更详细的描述,本申请的上述以及其 他目的、特征和优势将变得更加明显。附图用来提供对本申请实施例的进一步理解,并且构成说明书的一部分,与本申请实施例一起用于解释本申请,并不构成对本申请的限制。在附图中,相同的参考标号通常代表相同部件。By describing the embodiments of the present application in more detail with reference to the accompanying drawings, the above and other objects, features, and advantages of the present application will become more apparent. The drawings are used to provide a further understanding of the embodiments of the present application, and form a part of the specification, and are used to explain the present application together with the embodiments of the present application, and do not constitute a limitation on the present application. In the drawings, the same reference numerals generally represent the same components.
图1为根据本发明一实施例的引流监控系统的方框示意图;1 is a block schematic diagram of a drainage monitoring system according to an embodiment of the invention;
图2为根据本发明一实施例的图像处理模块的方框示意图;2 is a block diagram of an image processing module according to an embodiment of the invention;
图3为根据本发明另一实施例的图像处理模块的方框示意图;3 is a block diagram of an image processing module according to another embodiment of the present invention;
图4为根据本发明一实施例的监测模块的结构框图;4 is a structural block diagram of a monitoring module according to an embodiment of the present invention;
图5为根据本发明一实施例的中央监控模块的结构框图;5 is a structural block diagram of a central monitoring module according to an embodiment of the present invention;
图6为根据本发明一实施例的引流监控方法的流程图。6 is a flowchart of a method for monitoring drainage according to an embodiment of the present invention.
具体实施方式detailed description
下面结合附图和实施例对本申请作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅是用于解释相关发明,而非对该发明的限定。The present application will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the related invention, but not to limit the invention.
本发明的监测系统适用于各种涉及引流的医疗过程,在引流过程中,腹腔液、胸腔液等体液一般由待引流腔室通过医用引流导管流出,最终由引流容器进行收容,该引流容器可以是医疗过程中所有的引流容器,例如引流瓶、引流袋、负压引流器或手术中吸引器等,其一般放置于腔室下方从而形成液压差以实现对体液的引流。The monitoring system of the present invention is suitable for various medical procedures involving drainage. In the drainage process, body fluids such as abdominal fluid and pleural fluid generally flow out of the drainage chamber through the medical drainage catheter, and are finally contained by the drainage container. The drainage container can It is all the drainage containers in the medical process, such as drainage bottles, drainage bags, negative pressure drainage devices or intraoperative suction devices, which are generally placed under the chamber to form a hydraulic pressure difference to achieve the drainage of body fluids.
如前面描述,现有的引流装置一般是通过人工监测引流液的引流量、颜色等数据,容易由于缺乏监控而引发风险,为此本发明提出了能够对引流过程中的引流数据进行检测并进行监控的装置。本发明中使用术语“引流装置”,其含义既包括用于收容引流液的引流容器,也包括连通于患者引流部位和引流容器的引流管,还可包括与引流容器连接的负压装置。为了实现对引流液的颜色的监测,引流管、引流容器优选采样透明材料制成,例如玻璃或透明硅胶等。As described above, the existing drainage devices generally manually monitor the drainage flow, color and other data of the drainage liquid, which is easy to cause risks due to the lack of monitoring. Therefore, the present invention proposes to be able to detect and perform the drainage data during the drainage process Monitoring device. The term "drainage device" is used in the present invention, and its meaning includes both a drainage container for containing drainage fluid, a drainage tube connected to the drainage site of the patient and the drainage container, and a negative pressure device connected to the drainage container. In order to monitor the color of the drainage liquid, the drainage tube and the drainage container are preferably made of sampling transparent materials, such as glass or transparent silica gel.
图1是根据本发明第一实施例的引流监控系统的示意图。如图1所示,引流监控装置包括:视频采集装置10,其可对引流液进行拍摄,获取引流液的视频流数据;图像处理模块20,其与所述视频采集装置10连接,可接收所述视频流数据,并对所述视频流数据进行处理,以获得引流液的引流数据;以及监测模块30,其与图像处理模块20相连接,用于接收并监测所述引流数据。FIG. 1 is a schematic diagram of a drainage monitoring system according to a first embodiment of the present invention. As shown in FIG. 1, the drainage monitoring device includes: a video collection device 10, which can shoot the drainage liquid to obtain the video stream data of the drainage liquid; and an image processing module 20, which is connected to the video collection device 10 and can receive The video stream data, and process the video stream data to obtain the drainage data of the drainage liquid; and a monitoring module 30, which is connected to the image processing module 20, is used to receive and monitor the drainage data.
视频采集装置10可采用摄像头等光学传感器件,摄像头连续采集图像数据序列,形成视频流数据。相比于单纯的图像数据,本发明采用视频数据可以实现对引流过程的动态实时监测。The video capture device 10 may use optical sensor devices such as a camera, and the camera continuously collects image data sequences to form video stream data. Compared with pure image data, the present invention uses video data to achieve dynamic real-time monitoring of the drainage process.
如图1所示,视频采集装置10对准引流装置40从而对引流过程进行拍摄。至少设置一个视频采集装置,在一实施方式中,可以只设置一个对准引流容器的第一摄像头,从而实现对引流容器内的引流液的监控,在本发明中,引流容器的侧面上带有体积刻度,为了识别方便,可以在引流容器的各侧面都印上体积刻度线,该体积刻度线采用黑色印刷,并耐磨、耐腐蚀,由此采集的视频数据包含了引流量、颜色等信息;在另一实施方式中,还可另外设置对准引流管的第二摄像头,用于获取流经引流管的引流液的颜色信息。术后引流过程中如果发生血管破裂等危险情形,而引流容器内的引流液颜色变化不及引流管内的引流液颜色变化明显,因此通过第二摄像头的采集数据可更灵敏地监控此类危险。As shown in FIG. 1, the video capture device 10 is aimed at the drainage device 40 to shoot the drainage process. At least one video acquisition device is provided. In one embodiment, only one first camera aligned with the drainage container may be provided, so as to implement monitoring of the drainage liquid in the drainage container. In the present invention, the side of the drainage container is provided with Volume scale. For easy identification, volume scale lines can be printed on each side of the drainage container. The volume scale lines are printed in black and are wear-resistant and corrosion-resistant. The video data collected from this contains information such as flow rate and color. In another embodiment, a second camera aligned with the drainage tube may be additionally provided for acquiring color information of the drainage liquid flowing through the drainage tube. If there is a dangerous situation such as blood vessel rupture during the postoperative drainage process, the color change of the drainage liquid in the drainage container is not as obvious as the color change of the drainage liquid in the drainage tube, so the collected data through the second camera can monitor such danger more sensitively.
视频采集装置10可拆卸地安装在引流容器或负压装置上,也可以与引流容器一同安装在IV架上,既保证引流容器位于患者引流腔室以下,同时视频采集装置与引流容器的位置相对固定,保证了视频采集数据的格式一致性。在一些方式下,可设置光源,以保证对夜间的引流过程拍摄的清晰度,根据具体情况也可以不使用光源。The video acquisition device 10 is detachably mounted on the drainage container or negative pressure device, and can also be installed on the IV rack together with the drainage container, which ensures that the drainage container is located below the drainage chamber of the patient, and the video acquisition device and the drainage container are positioned opposite Fixed, to ensure the consistency of the format of the video acquisition data. In some ways, a light source can be set to ensure the clarity of the shooting at night during the drainage process, and the light source may not be used according to the specific situation.
图像处理模块20接收摄像头拍摄的视频数据,并通过图像处理方式获得引流液的颜色、浑浊度及引流量等引流数据。在一实施方式中,如图2所示,图像处理模块包括图像采样模块21、颜色提取模块22、浑浊度检测模块23和引流量读取模块24。The image processing module 20 receives the video data captured by the camera, and obtains the drainage data such as the color, turbidity, and drainage volume of the drainage liquid through the image processing method. In one embodiment, as shown in FIG. 2, the image processing module includes an image sampling module 21, a color extraction module 22, a turbidity detection module 23 and a drainage flow reading module 24.
视频流数据可视为按一定顺序进行排放的图像序列组成,图像采样模块21用于从摄像头采集的视频流数据中提取关键帧图像。本文使用“关键帧图像”,表示可从中获取引流数据的图像。图像采集模块21可以固定采样频率提取视频流数据中的关键帧图像,例如每秒提取1帧图像,也可以如下面描述,根据引流数据的变化而调整关键帧图像的采样率,从而可实现对引流过程某一时间段的动态精确监测。The video stream data can be regarded as a sequence of images discharged in a certain order. The image sampling module 21 is used to extract key frame images from the video stream data collected by the camera. This article uses "key frame images" to denote images from which drainage data can be obtained. The image acquisition module 21 can extract the key frame image in the video stream data at a fixed sampling frequency, for example, extract one frame image per second, or adjust the sampling rate of the key frame image according to the change of the drainage data as described below, so as to achieve The dynamic and accurate monitoring of a certain period of time during the drainage process.
颜色提取模块22用于对所述关键帧图像进行图像识别,提取所述关键帧图像的色彩信息。在一实施方式中,可只针对第一摄像头或第二摄像头的关键帧图像进行图像识别提取其色彩信息,也可同时针对第一摄像头和第二 摄像头的关键帧图像进行图像识别提取色彩信息,并可比较分析获得患者的引流情况,由于对准引流管的第二摄像头的图像的色彩信息更能表征引流液的实时颜色,因此颜色提取模块22优选提取第二摄像头的关键帧图像中的色彩信息。The color extraction module 22 is used to perform image recognition on the key frame image and extract color information of the key frame image. In one embodiment, the key frame images of the first camera or the second camera may be used for image recognition to extract color information, or the key frame images of the first camera and the second camera may be used for image recognition to extract color information. It can be compared and analyzed to obtain the patient's drainage situation. Since the color information of the image of the second camera aligned with the drainage tube can better characterize the real-time color of the drainage liquid, the color extraction module 22 preferably extracts the color in the key frame image of the second camera information.
在一实施方式中,颜色提取模块22可按照预设的采样规则采集关键帧图像的多个采样点的RGB值,再根据多个采样点的色彩值估算出关键帧图像的色彩信息。一般可认为,同一关键帧图像的引流液区域的颜色是基本相同的,因此该区域的少数几个像素的色彩值能够表示图像中的绝大部分像素,采集引流瓶或引流管作为采样区域,在该采样区域内选取多个采样点并采集其色彩值,从而可提取图像的色彩信息。In one embodiment, the color extraction module 22 may collect the RGB values of multiple sampling points of the key frame image according to a preset sampling rule, and then estimate the color information of the key frame image according to the color values of the multiple sampling points. Generally speaking, the color of the drainage area of the same key frame image is basically the same, so the color value of a few pixels in this area can represent most of the pixels in the image, and the collection bottle or drainage tube is used as the sampling area. Select multiple sampling points in the sampling area and collect their color values, so that the color information of the image can be extracted.
由于光照或者引流容器的透射率等因素影响,会对关键帧图像的色彩造成干扰。为此,在一实施方式中可对获取的色彩信息进行校正,例如先由摄像头拍摄标准色卡的图像并提取其颜色,将其和标准色进行比较获得两者偏差值作为校正因子,并采用该校正因子对从关键帧图像中提取的引流液颜色进行校正。Due to the influence of factors such as lighting or the transmittance of the drainage container, it will cause interference to the color of the key frame image. To this end, in one embodiment, the acquired color information can be corrected, for example, the camera takes an image of the standard color card and extracts its color, and compares it with the standard color to obtain the deviation between the two as a correction factor, and uses The correction factor corrects the color of the drainage fluid extracted from the key frame image.
在一实施方式中,图像采样模块21配置为基于所述色彩信息的变化而调整采样率。该色彩信息的变化可以基于三通道的RGB值来计算引流液的颜色随时间的变化值,其既可以是引流液整体颜色的变化量,也可以是某单一通道色值的变化量。在引流液颜色变化剧烈的情形下,例如图像的R值变化超过一阈值时,其可能表示患者引流出现异常,此时应提高从视频流数据提取关键帧图像的采样率,例如由每秒提取1帧图像调整为每秒提取5帧图像,使得对引流过程的监测更加精准。In one embodiment, the image sampling module 21 is configured to adjust the sampling rate based on the change of the color information. The change of the color information can be based on the RGB values of the three channels to calculate the change value of the color of the drainage liquid over time, which can be either the amount of change in the overall color of the drainage liquid or the amount of change in the color value of a single channel. In the case of drastic changes in the color of the drainage fluid, for example, when the R value of the image exceeds a threshold, it may indicate that the patient's drainage is abnormal. In this case, the sampling rate of the key frame image extracted from the video stream data should be increased, such as by the second One frame image is adjusted to extract 5 frames per second, which makes the monitoring of the drainage process more accurate.
浑浊度检测模块23用于对所述关键帧图像进行处理,确定引流液的浑浊度信息。在本发明中采用图像的亮度信息表征引流液的浑浊度。在一实施例中,浑浊度检测模块包括:亮度提取模块,其从所述关键帧图像中提取所述图像的亮度值;浑浊度确定模块,基于所述亮度值表征引流液的浑浊度信息。The turbidity detection module 23 is used to process the key frame image to determine the turbidity information of the drainage fluid. In the present invention, the brightness information of the image is used to characterize the turbidity of the drainage fluid. In one embodiment, the turbidity detection module includes: a brightness extraction module that extracts the brightness value of the image from the key frame image; a turbidity determination module that characterizes the turbidity information of the drainage fluid based on the brightness value.
可采用多种方式提取关键帧图像的亮度值,例如可将关键帧图像由RGB空间转换为YUV格式图像,并采用Y值作为引流液的浑浊度信息,具体换算方式为Y=0.299*R+0.587*G+0.114*B。在一实施方式中,也可将将关键帧图像由RGB空间转化为其它色彩模式的图像,例如将LAB的L分量、 HSI的I分量作为像素的亮度值。The brightness value of the key frame image can be extracted in various ways. For example, the key frame image can be converted from RGB space to a YUV format image, and the Y value is used as the turbidity information of the drainage fluid. The specific conversion method is Y=0.299*R+ 0.587*G+0.114*B. In one embodiment, the key frame image may be converted from RGB space to another color mode image, for example, the L component of LAB and the I component of HSI may be used as the brightness value of the pixel.
在提取了例如图像中的引流管区域的所有像素的亮度值后,可以通过计算其平均值或均方值表征引流液的浑浊度信息,如果该数值大于一阈值,表明引流液为正常的澄清状态,而如果该值低于一阈值,则表明引流液内可能存在血块而导致其呈现浑浊状态。After extracting, for example, the brightness values of all pixels in the area of the drainage tube in the image, the turbidity information of the drainage fluid can be characterized by calculating its average or mean square value. If the value is greater than a threshold, it indicates that the drainage fluid is normal and clear Status, and if the value is lower than a threshold, it indicates that there may be blood clots in the drainage fluid, causing it to appear cloudy.
引流量读取模块24用于对关键帧图像进行图像识别和增强处理,读取关键帧图像中的刻度值信息,该刻度值信息即表征了引流容器内收容的引流液的体积。在一实施方式中,可基于引流液的液位而确定上述刻度值信息。具体而言,先将关键帧图像转换为灰度模式,再对图像进行中值滤波处理,使得图像中的液位信息增强,处理后的图像进行边缘增强处理,从而提取引流容器内的液位线,基于该液位线的像素坐标即可计算出引流液的体积。在一示例中,第一摄像头设置在能够对准引流容器的两个侧面的体积刻度线的方向上,从而在关键帧图像中有两条液位线,此时可基于两液位线的平均像素坐标计算出引流液的体积,以平衡摄像头与液位线可能存在的角度差的影响。The drainage flow reading module 24 is used to perform image recognition and enhancement processing on the key frame image, and read the scale value information in the key frame image. The scale value information represents the volume of the drainage liquid contained in the drainage container. In one embodiment, the scale value information may be determined based on the level of the drainage fluid. Specifically, first convert the key frame image to grayscale mode, and then perform median filtering on the image to enhance the liquid level information in the image, and the processed image is subjected to edge enhancement processing to extract the liquid level in the drainage container Line, based on the pixel coordinates of the liquid level line, the volume of drainage fluid can be calculated. In an example, the first camera is set in a direction that can be aligned with the volume scale lines on the two sides of the drainage container, so that there are two liquid level lines in the key frame image, which can be based on the average of the two liquid level lines Pixel coordinates calculate the volume of the drainage fluid to balance the possible angle difference between the camera and the liquid level line.
在另一实施例中,本发明还可采用机器学习的方式提取引流数据中的色彩特征及浑浊度特征。如图3所示,所述图像处理模块包括:图像采样模块21’、图像特征提取模块22’和引流量读取模块24’,其中图像采集模块21’和引流量读取模块24’的功能和配置与前面描述的图像采集模块21和引流读取模块24相同,此处不再赘述。In another embodiment, the present invention can also use machine learning to extract color features and turbidity features in the drainage data. As shown in FIG. 3, the image processing module includes: an image sampling module 21', an image feature extraction module 22' and a drainage flow reading module 24', in which the image acquisition module 21' and the drainage flow reading module 24' function The configuration is the same as that of the image acquisition module 21 and the drainage reading module 24 described above, which will not be repeated here.
图像特征提取模块22’为基于神经网络训练获得的模型,用于从关键帧图像中提取颜色特征及浑浊度特征。在一实施方式中,神经网络可采用卷积神经网络CNN模型,同时采用YUV颜色空间作为模型的输入特征,其独立体现了图像的亮度和色度信息。通过训练神经网络而获得检测模型,并使用模型中某一层的输入作为色彩特征和浑浊度特征的描述子,则对任何实际拍摄的图像,将其输入该模型,可以得到该图像所表示的引流数据的描述。具体的,在引流管的待识别区域内,提取一定数量的像素并把其颜色值转化到YUV颜色空间的颜色值,再把该数据输入到训练好的CNN模型中进行颜色和浑浊度识别。The image feature extraction module 22' is a model obtained based on neural network training and is used to extract color features and turbidity features from key frame images. In one embodiment, the neural network may use a CNN model of a convolutional neural network, while using the YUV color space as the input feature of the model, which independently reflects the brightness and chrominance information of the image. By training a neural network to obtain a detection model, and using the input of a certain layer in the model as a descriptor of color features and turbidity features, any actual captured image can be input into the model to obtain the representation of the image Drainage data description. Specifically, in the area to be recognized of the drainage tube, a certain number of pixels are extracted and their color values are converted into the color values of the YUV color space, and then the data is input into the trained CNN model for color and turbidity recognition.
在一实施方式中,图像采样模块21’可配置为基于所述色彩特征的变化而调整采样率。其功能和原理与前面的图像采集模块21相同,此处不再赘 还。In one embodiment, the image sampling module 21' may be configured to adjust the sampling rate based on the change in the color characteristics. Its function and principle are the same as the previous image acquisition module 21, and will not be repeated here.
返回至图1,图像处理模块20通过数据线连接至监测模块30,其接收引流液的颜色、浑浊度及引流量等引流数据。同时,如下面描述,监测模块30可将接收的引流数据与设定值进行比较,从而监测所述引流数据。Returning to FIG. 1, the image processing module 20 is connected to the monitoring module 30 through a data line, which receives drainage data such as the color, turbidity, and drainage volume of the drainage fluid. Meanwhile, as described below, the monitoring module 30 may compare the received drainage data with a set value, thereby monitoring the drainage data.
在一实施方式中,监测模块30可基于所述引流液的引流量数据计算流经引流管的引流液的流速。具体地,例如图像采样模块每秒提取1帧图像,引流量读取模块分别读取第1帧图像的刻度值信息L1和第30帧图像的刻度值信息L2,则30秒内引流量为L2-L1,由此可计算出流经直径为D的引流管的流速v=4*(L2-L1)/(30*πD 2)。 In an embodiment, the monitoring module 30 may calculate the flow rate of the drainage liquid flowing through the drainage tube based on the drainage flow data of the drainage liquid. Specifically, for example, the image sampling module extracts one frame of image per second, and the drainage reading module reads the scale value information L1 of the first frame image and the scale value information L2 of the 30th frame image respectively, then the drainage volume is L2 within 30 seconds -L1, from which the flow velocity v through the drainage tube of diameter D=4*(L2-L1)/(30*πD 2 ) can be calculated.
此外,监测模块30还可配置为基于所述颜色和浑浊度的变化确定引流液的性状改变,所述性状改变可为引流液中掺杂了异常物,例如引流液中出现了血块或气体,其均会造成引流液的颜色或浑浊度出现变化。如上描述,颜色的变化可以基于三通道的RGB值来计算引流液的颜色随时间的变化值,该变化值既可以是引流液整体颜色的变化量,也可以是某一通道的色值变化量。浑浊度的变化可以基于图像的亮度值进行监测,在引流液的性状变化超过了预设的阈值时,监测模块30可启动报警,及时提醒患者家属或者医护人员查看或进行处理。In addition, the monitoring module 30 may be further configured to determine a change in the properties of the drainage fluid based on the changes in the color and turbidity. The change in the properties may be that the drainage fluid is doped with an abnormal substance, for example, a blood clot or gas appears in the drainage fluid. All of them will cause the color or turbidity of the drainage fluid to change. As described above, the color change can be based on the three-channel RGB value to calculate the color change value of the drainage fluid over time. The change value can be either the amount of change in the overall color of the drainage fluid or the amount of change in the color value of a channel . The change of the turbidity can be monitored based on the brightness value of the image. When the change of the properties of the drainage fluid exceeds the preset threshold, the monitoring module 30 can start an alarm to promptly remind the patient's family or medical staff to view or process it.
在一示例中,如图4所述,监测模块30包括第一数据接收单元31、数据处理单元32和第一显示单元33,所述第一数据接收单元31和图像处理模块20通过数据线连接,用于接收引流液的颜色、浑浊度、引流量数据,并将所接收的数据传送至数据处理单元32,数据处理单元32可对相关数据进行运算,例如基于引流量数据计算流经引流管的引流液的流速,以及基于颜色和浑浊度的变化确定引流液的性状改变,在一示例中,数据处理单元32还可基于流速和当前引流瓶的体积计算预计充满时间。并将引流数据中的至少一个通过第一显示单元33进行实时显示。因为引流瓶或引流袋多置于病床底部或被遮盖,通过对引流数据的实时显示,可使得对引流量、引流颜色或者浑浊度等数据的观察更加方便。In an example, as shown in FIG. 4, the monitoring module 30 includes a first data receiving unit 31, a data processing unit 32 and a first display unit 33, the first data receiving unit 31 and the image processing module 20 are connected by a data line , Used to receive the color, turbidity, and drainage data of the drainage fluid, and transmit the received data to the data processing unit 32. The data processing unit 32 can perform calculations on the relevant data, such as calculating the flow through the drainage tube based on the drainage flow data The flow rate of the drainage fluid and the change in the properties of the drainage fluid based on the change in color and turbidity. In one example, the data processing unit 32 can also calculate the estimated full time based on the flow velocity and the volume of the current drainage bottle. At least one of the drainage data is displayed in real time by the first display unit 33. Because the drainage bottle or drainage bag is mostly placed at the bottom of the bed or is covered, the real-time display of the drainage data can make it easier to observe the drainage flow, drainage color, or turbidity.
第一显示单元33显示的内容可根据具体的需要进行选择。其个数也可根据需要而调整,可设置一个显示单元,也可设置多个显示单元,例如分别设置在病床旁和护士站。第一显示单元33可以是各种形式的显示单元,如液晶显示屏、光柱、数字显示可调节仪表等等,并且可以是一体式的,也可 是分体式的。其中对于引流液的颜色显示方式,可通过颜色信息直观显示,也可以通过RGB分量进行数值显示。在一实施例中,第一显示单元33还可以是手持式PDA等操作设备,引流数据无线传输至该设备以供医务人员随时查看。第一显示单元33与数据处理单元32以有线或无线方式进行连接,例如引流数据可通过蓝牙传输到第一显示单元33,以达到远程实时监测的目的。The content displayed by the first display unit 33 can be selected according to specific needs. The number can also be adjusted according to the needs, one display unit can be set, or multiple display units can be set, for example, they are set beside the bed and the nurse station respectively. The first display unit 33 may be a display unit of various forms, such as a liquid crystal display, a light column, a digital display adjustable instrument, etc., and may be an integrated type or a split type. Among them, the color display method of the drainage liquid can be visually displayed through the color information, and can also be displayed numerically through the RGB component. In an embodiment, the first display unit 33 may also be an operation device such as a handheld PDA, and the drainage data is wirelessly transmitted to the device for medical personnel to view at any time. The first display unit 33 and the data processing unit 32 are connected in a wired or wireless manner, for example, the drainage data can be transmitted to the first display unit 33 via Bluetooth to achieve the purpose of remote real-time monitoring.
作为示例,数据处理单元32可以用具有数据运算和处理能力的单片机、处理器等实现对引流数据的计算处理,其还可包括与处理器连接的输入系统、输出系统以及无线通信模块。在一示例中,数据处理单元32通过有线或无线方式与负压治疗设备连接,例如在判断出引流液性状改变,判断提示引流液中存在气体时,则发出控制信号给负压治疗设备,例如增大负压以抽吸气体。As an example, the data processing unit 32 may use a single chip microcomputer, a processor, and the like with data calculation and processing capabilities to perform calculation processing on the drainage data, and it may further include an input system, an output system, and a wireless communication module connected to the processor. In an example, the data processing unit 32 is connected to the negative pressure treatment device through a wired or wireless method. For example, when it is judged that the drainage fluid property changes and it is judged that there is gas in the drainage fluid, a control signal is sent to the negative pressure treatment device, for example Increase the negative pressure to draw gas.
在一示例中,监测模块30还包括第一报警单元34,所述第一报警单元34用于在确定的引流量、流速、颜色、浑浊度和性状改变中的至少一个超过预定阈值时发出警报信号,例如数据处理单元32可将该浑浊度与一预定阈值进行比较,从而判断出引流液中是否出现血块等异常情况,并据此触发第一报警单元34生成警报信号。该预定阈值可在数据处理单元32中固定设置,也可通过阈值设置单元36等控制面板的输入系统进行输入设置,从而可根据不同引流类型以及患者体征设置不同的阈值。警报信号可以是诸如声光之类的警报信号,从而引起患者及其家属或者医护人员的注意,提醒关注引流情况,从而减轻了医护人员的工作负担。还例如在临床中可能会发生由于血管破裂而导致引流液性状短时间内突然变化的情况,如果不能及时发现极易延误最佳治疗时期,通过本发明的监测装置可及时发现这类异常情况,避免了由于监控过程中医护人员的缺乏或疏忽等原因而造成的医疗风险。In an example, the monitoring module 30 further includes a first alarm unit 34 for issuing an alarm when at least one of the determined drainage volume, flow rate, color, turbidity, and property changes exceeds a predetermined threshold For example, the data processing unit 32 may compare the turbidity with a predetermined threshold to determine whether abnormalities such as blood clots appear in the drainage fluid, and accordingly trigger the first alarm unit 34 to generate an alarm signal. The predetermined threshold may be fixedly set in the data processing unit 32, or may be input and set through an input system of a control panel such as the threshold setting unit 36, so that different thresholds may be set according to different drainage types and patient signs. The alarm signal may be an alarm signal such as sound and light, thereby attracting the attention of the patient and his family or medical staff, and reminding the attention of the drainage situation, thereby reducing the workload of the medical staff. For example, in the clinical situation, a sudden change of the drainage fluid properties may occur in a short time due to rupture of blood vessels. If the optimal treatment period is not easily found in time, such abnormal conditions can be found in time by the monitoring device of the present invention. The medical risks caused by the lack or negligence of medical staff during the monitoring process are avoided.
如图4-5所示,监控系统还包括中央监控模块50,其可作为护士站的监控中心、或者医院的监控管理中心的监控功能的一部分,用于实时监控多个监测模块30的监测数据,各监测模块的数据处理单元32可将引流数据与对应患者的标识信息(姓名、床号、年龄等)相关联,并通过通信单元35将相应数据以有线或无线方式发送至中央监控模块50,其包括:第二数据接收单元51,用于接收多个监测模块发送的监测数据,存储单元52,用于记录存储所述监测数据,以及第二显示单元53,用于同时显示多个监测模块的监 测数据,例如可显示患者标识信息、引流数据、引流容器预计充满时间等内容,并通过图像显示引流量、流速、颜色和/或浑浊度随时间变化的曲线图等数据。基于上述功能,中央监控模块50可集中监控医院病房的某一层或全部床位上的引流患者的相关数据,方便统一调度管理。As shown in FIGS. 4-5, the monitoring system further includes a central monitoring module 50, which can be used as a part of the monitoring function of the monitoring center of the nurse station or the monitoring management center of the hospital to monitor the monitoring data of multiple monitoring modules 30 in real time The data processing unit 32 of each monitoring module can associate the drainage data with the identification information (name, bed number, age, etc.) of the corresponding patient, and send the corresponding data to the central monitoring module 50 in a wired or wireless manner through the communication unit 35 , Which includes: a second data receiving unit 51 for receiving monitoring data sent by a plurality of monitoring modules, a storage unit 52 for recording and storing the monitoring data, and a second display unit 53 for displaying multiple monitoring simultaneously The monitoring data of the module, for example, can display patient identification information, drainage data, the estimated full time of the drainage container, etc., and display the data such as the curve of drainage volume, flow rate, color and/or turbidity with time through the image. Based on the above functions, the central monitoring module 50 can centrally monitor the relevant data of the drainage patients on a certain floor or all beds of the hospital ward, which is convenient for unified dispatch management.
在一示例中,中央监控模块50还可包括:信息处理单元56,其配置为对接收到的标识信息和引流数据进行处理,通过信息处理单元56和存储单元52,可以对患者的标识信息和引流数据进行编辑处理,从而方便医院工作人员集中存储并查询每个患者的历史引流数据。中央监控模块50还可以包括阈值设置单元52和第二报警单元54,其分别用于设置每个监测模块的监测数据的预定阈值,以及用于在多个监测模块中的任意一个的监测数据超过预定阈值时,发出警报信号。可以理解,前述第一报警单元34和第二报警单元54可分别警示患者本人/家属和护士/医生引流情况出现异常,提醒医务工作人员采取必要的措施,因此能最大限度地降低医疗风险。In an example, the central monitoring module 50 may further include: an information processing unit 56 configured to process the received identification information and drainage data, and through the information processing unit 56 and the storage unit 52, the patient's identification information and The drainage data is edited and processed, so that the hospital staff can centrally store and query the historical drainage data of each patient. The central monitoring module 50 may further include a threshold setting unit 52 and a second alarm unit 54 which are respectively used to set a predetermined threshold value of the monitoring data of each monitoring module and that the monitoring data of any one of the multiple monitoring modules exceeds When the threshold is predetermined, an alarm signal is issued. It can be understood that the first alarm unit 34 and the second alarm unit 54 can respectively alert the patient/family and nurse/doctor of the abnormal drainage situation, and remind the medical staff to take necessary measures, so that the medical risk can be minimized.
图6是根据本申请一实施例的引流监控方法的流程图,包括以下步骤:FIG. 6 is a flowchart of a drainage monitoring method according to an embodiment of the present application, including the following steps:
在步骤S110中,获取引流液的视频流数据。In step S110, the video stream data of the drainage fluid is acquired.
本发明的引流监控方法可应用于多种医疗过程,所述引流液包括术中的腔液引流、术后尿液引流等各种引流液体。在一实施方式中,可采用200万像素的摄像头等视频采集装置对准引流装置从而对引流过程进行拍摄并获取视频流数据。并可存储为AVI、MPG等通用格式。相比于图像拍摄,本发明采用获取视频流数据,能够对引流过程进行动态监测,因此实现了更加精准的引流监控。The drainage monitoring method of the present invention can be applied to various medical procedures, and the drainage fluid includes various drainage fluids such as intraoperative lumen drainage and postoperative urine drainage. In one embodiment, a video collection device such as a 2 million pixel camera can be used to align the drainage device to capture the drainage process and obtain video stream data. And can be stored as AVI, MPG and other general formats. Compared with image shooting, the present invention uses video stream data to dynamically monitor the drainage process, thus achieving more accurate drainage monitoring.
在步骤S120中,对所述视频流数据进行处理,以获得所述引流液的引流数据。In step S120, the video stream data is processed to obtain drainage data of the drainage fluid.
对视频流数据的处理可以基于微控制器芯片或DSP处理器等具有图像处理能力的数据处理器上实现。获得的引流数据包括引流液的引流量、颜色及浑浊度等数据,相应地,对视频流数据的处理包括图像采样、颜色提取、浑浊度检测、引流量读取,其具体处理可采用前面描述的图像处理模块实现,此处不再赘述。通过对视频流数据的处理能集中得到引流液的引流量、颜色、浑浊度等数据,从而可获得患者引流的全方位信息。The processing of video stream data can be implemented on a data processor with image processing capabilities such as a microcontroller chip or a DSP processor. The obtained drainage data includes the drainage flow, color, and turbidity of the drainage liquid. Correspondingly, the processing of the video streaming data includes image sampling, color extraction, turbidity detection, and drainage flow reading. The specific processing can be described above The image processing module is implemented and will not be repeated here. Through the processing of the video stream data, data such as the drainage volume, color, and turbidity of the drainage liquid can be obtained in a centralized manner, thereby obtaining all-round information on the drainage of the patient.
在步骤S130中,接收并监测所述引流数据。In step S130, the drainage data is received and monitored.
可以用具有数据运算和处理能力的单片机、处理器等实现对引流数据的 计算处理和监测。进一步地,基于引流量、颜色、浑浊度可以计算引流速度和引流液的性状改变,这些数据均可以通过在线显示在屏幕或者移动终端。例如,通过对引流数据的显示处理,可以用于术中引流过程中医生对患者的体征监测,也可以用于术后引流医护人员对患者康复情况的监测。通过监测和报警功能,可减轻患者和医疗工作人员的工作负担,并最大限度地降低医疗风险,成本低廉,可产生良好的经济效益。You can use single-chip computers and processors with data calculation and processing capabilities to calculate and monitor the drainage data. Further, based on the drainage volume, color, and turbidity, the drainage speed and the properties of the drainage fluid can be calculated. These data can be displayed on the screen or mobile terminal online. For example, through the display and processing of drainage data, it can be used to monitor the signs of the patient during the operation of the drainage process, and can also be used to monitor the recovery of the patient by the medical staff after the drainage. Through monitoring and alarm functions, it can reduce the workload of patients and medical staff, and minimize medical risks, low cost, and can produce good economic benefits.
为了例示和描述的目的已经给出了以上描述。此外,此描述不意图将本申请的实施例限制到在此公开的形式。任何熟悉本技术领域的技术人员在不脱离本发明的范围和思想的情况下,可以进行形式和细节上的各种变化和修改。即本发明的范围由所附权利要求及其等价物定义。The above description has been given for the purpose of illustration and description. Furthermore, this description is not intended to limit the embodiments of the present application to the form disclosed herein. Any person skilled in the art can make various changes and modifications in form and detail without departing from the scope and ideas of the present invention. That is, the scope of the present invention is defined by the appended claims and their equivalents.

Claims (15)

  1. 一种基于图像识别的引流监控系统,包括:A drainage monitoring system based on image recognition, including:
    至少一个视频采集装置,用于获取引流液的视频流数据;At least one video acquisition device for acquiring video stream data of drainage fluid;
    图像处理模块,其与所述至少一个视频采集装置连接,用于接收所述视频流数据并对所述视频流数据进行处理,以获得所述引流液的引流数据;以及An image processing module, connected to the at least one video acquisition device, for receiving the video stream data and processing the video stream data to obtain drainage data of the drainage fluid; and
    监测模块,其与所述图像处理模块相连接,用于接收并监测所述引流数据。A monitoring module connected to the image processing module is used to receive and monitor the drainage data.
  2. 如权利要求1所述的引流监控系统,其中,所述视频采集装置包括对准引流容器的第一视频采集装置,任选地,还包括对准引流管的第二视频采集装置。The drainage monitoring system according to claim 1, wherein the video collection device includes a first video collection device aligned with the drainage container, and optionally, a second video collection device aligned with the drainage tube.
  3. 如权利要求1所述的引流监控系统,其中,所述引流数据包括引流液的颜色、浑浊度及引流量。The drainage monitoring system according to claim 1, wherein the drainage data includes color, turbidity and drainage volume of the drainage fluid.
  4. 如权利要求3所述的引流监控系统,其中,所述监测模块还配置为基于所述引流液的引流量数据计算流经引流管的引流液的流速。The drainage monitoring system according to claim 3, wherein the monitoring module is further configured to calculate the flow rate of the drainage liquid flowing through the drainage tube based on the drainage flow data of the drainage liquid.
  5. 如权利要求3所述的引流监控系统,其中,所述监测模块还配置为基于所述颜色和浑浊度的变化确定引流液的性状改变。The drainage monitoring system according to claim 3, wherein the monitoring module is further configured to determine a property change of the drainage liquid based on the change in the color and turbidity.
  6. 如权利要求1所述的引流监控系统,其中所述图像处理模块包括:The drainage monitoring system of claim 1, wherein the image processing module comprises:
    图像采样模块,用于从所述视频流数据中提取关键帧图像;An image sampling module, used for extracting key frame images from the video stream data;
    颜色提取模块,用于对所述关键帧图像进行图像识别,提取所述关键帧图像的色彩信息;A color extraction module, used to perform image recognition on the key frame image and extract color information of the key frame image;
    浑浊度检测模块,用于对所述关键帧图像进行处理,确定所述引流液的浑浊度信息;A turbidity detection module, configured to process the key frame image to determine the turbidity information of the drainage fluid;
    引流量读取模块,用于对所述关键帧图像进行图像识别和增强处理,读取所述关键帧图像中的刻度值信息。The drainage reading module is used to perform image recognition and enhancement processing on the key frame image, and read the scale value information in the key frame image.
  7. 如权利要求6所述的引流监控系统,其中所述图像采样模块配置为基于所述色彩信息的变化而调整采样率。The drainage monitoring system of claim 6, wherein the image sampling module is configured to adjust the sampling rate based on the change of the color information.
  8. 如权利要求6所述的引流监控系统,其中所述浑浊度检测模块包括:The drainage monitoring system of claim 6, wherein the turbidity detection module comprises:
    亮度提取模块,从所述关键帧图像中提取所述图像的亮度值;A brightness extraction module, extracting the brightness value of the image from the key frame image;
    浑浊度确定模块,基于所述亮度值表征所述引流液的浑浊度信息。The turbidity determination module characterizes the turbidity information of the drainage liquid based on the brightness value.
  9. 如权利要求1所述的引流监控系统,其中所述图像处理模块包括:The drainage monitoring system of claim 1, wherein the image processing module comprises:
    图像采样模块,用于从所述视频流数据中提取关键帧图像;An image sampling module, used for extracting key frame images from the video stream data;
    图像特征提取模块,用于从所述关键帧图像中提取色彩特征及浑浊度特征,其中所述图像特征提取模块为基于神经网络训练获得的模型。An image feature extraction module is used to extract color features and turbidity features from the key frame image, wherein the image feature extraction module is a model obtained based on neural network training.
  10. 如权利要求9所述的引流监控系统,其中所述图像采样模块配置为基于所述色彩特征的变化而调整采样率。The drainage monitoring system of claim 9, wherein the image sampling module is configured to adjust the sampling rate based on changes in the color characteristics.
  11. 如权利要求3所述的引流监控系统,其中,所述监测模块包括:The drainage monitoring system of claim 3, wherein the monitoring module comprises:
    第一数据接收单元,用于接收所述引流液的颜色、浑浊度及引流量数据;A first data receiving unit, configured to receive color, turbidity and drainage data of the drainage liquid;
    数据处理单元,用于基于所述引流量数据计算流经所述引流管的引流液流速,和基于所述颜色数据和浑浊度数据的变化确定引流液的性状改变;The data processing unit is used to calculate the flow rate of the drainage liquid flowing through the drainage tube based on the drainage flow data, and determine the property change of the drainage liquid based on the change of the color data and the turbidity data;
    第一显示单元,用于对所述颜色、浑浊度、引流量、流速、和性状改变中的至少一个进行实时显示;以及A first display unit for real-time display of at least one of the color, turbidity, drainage volume, flow rate, and property changes; and
    第一报警单元,用于在所述颜色、浑浊度、引流量、流速、和性状改变中的至少一个超过预定阈值时,发出警报信号。The first alarm unit is configured to issue an alarm signal when at least one of the color, turbidity, drainage volume, flow rate, and property change exceeds a predetermined threshold.
  12. 如权利要求11所述的引流监控系统,还包括:The drainage monitoring system according to claim 11, further comprising:
    中央监控模块,用于实时监控多个所述监测模块的监测数据。The central monitoring module is used to monitor the monitoring data of multiple monitoring modules in real time.
  13. 如权利要求12所述的引流监控系统,其中,所述中央监控模块包括:The drainage monitoring system of claim 12, wherein the central monitoring module includes:
    第二数据接收单元,用于接收多个所述监测模块以有线或无线方式发送的监测数据,所述监测数据包括所述颜色、浑浊度、引流量、流速和性状改 变中的至少一个;A second data receiving unit, configured to receive monitoring data sent by a plurality of the monitoring modules in a wired or wireless manner, the monitoring data including at least one of the color, turbidity, drainage volume, flow rate, and property changes;
    存储单元,用于存储所述监测数据;以及A storage unit for storing the monitoring data; and
    第二显示单元,用于同时显示多个所述监测模块的监测数据。The second display unit is used to simultaneously display the monitoring data of multiple monitoring modules.
  14. 如权利要求13所述的引流监控系统,其中,所述中央监控模块还包括:The drainage monitoring system according to claim 13, wherein the central monitoring module further comprises:
    第二报警单元,用于在多个所述监测模块中的任意一个的监测数据超过预定阈值时,发出警报信号;A second alarm unit, configured to issue an alarm signal when the monitoring data of any one of the plurality of monitoring modules exceeds a predetermined threshold;
    阈值设置单元,用于设置每个监测模块的监测数据的预定阈值。The threshold setting unit is used to set a predetermined threshold of the monitoring data of each monitoring module.
  15. 一种基于图像识别的引流监控方法,包括:A drainage monitoring method based on image recognition, including:
    获取引流液的视频流数据;Obtain the video stream data of drainage fluid;
    对所述视频流数据进行处理,以获得所述引流液的引流数据;以及Processing the video stream data to obtain drainage data of the drainage liquid; and
    接收并监测所述引流数据,Receive and monitor the drainage data,
    其中,所述引流数据包括所述引流液的颜色、浑浊度及引流量。Wherein, the drainage data includes the color, turbidity and drainage volume of the drainage liquid.
PCT/CN2019/126662 2018-12-29 2019-12-19 Drainage monitoring system and method based on image recognition WO2020135226A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021538480A JP7211668B2 (en) 2018-12-29 2019-12-19 Emission monitoring system and method based on image recognition
US17/304,841 US20210316060A1 (en) 2018-12-29 2021-06-26 Medical drainage monitoring method, apparatus, and system based on image recognition

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811652811.4 2018-12-29
CN201811652811.4A CN109498857B (en) 2018-12-29 2018-12-29 Drainage monitoring system and method based on image recognition

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/304,841 Continuation-In-Part US20210316060A1 (en) 2018-12-29 2021-06-26 Medical drainage monitoring method, apparatus, and system based on image recognition

Publications (1)

Publication Number Publication Date
WO2020135226A1 true WO2020135226A1 (en) 2020-07-02

Family

ID=65757188

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/126662 WO2020135226A1 (en) 2018-12-29 2019-12-19 Drainage monitoring system and method based on image recognition

Country Status (3)

Country Link
JP (1) JP7211668B2 (en)
CN (1) CN109498857B (en)
WO (1) WO2020135226A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115308101A (en) * 2022-09-27 2022-11-08 恒天益科技(深圳)有限公司 Water quality monitoring management method and system
CN117045884A (en) * 2023-10-11 2023-11-14 吉林医药学院 Drainage monitoring device for thoracic surgery

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109498857B (en) * 2018-12-29 2020-10-16 刘铁楠 Drainage monitoring system and method based on image recognition
US11318241B2 (en) 2019-03-27 2022-05-03 Medsix Inc. System and method for wound monitoring
CN110013574A (en) * 2019-05-10 2019-07-16 上海市东方医院(同济大学附属东方医院) Drainage liquid amount real-time monitoring method
CN110599879A (en) * 2019-09-26 2019-12-20 赣南医学院第一附属医院 Venous catheter tube washing and sealing teaching device and method
CN114053489A (en) * 2020-07-31 2022-02-18 西伯股份有限公司 Drainage bag management system and drainage bag thereof
CN112642022B (en) * 2020-12-31 2022-07-05 遵义师范学院 Infusion monitoring system and monitoring method
CN112861734A (en) * 2021-02-10 2021-05-28 北京农业信息技术研究中心 Trough food residue monitoring method and system
CN114397929B (en) * 2022-01-18 2023-03-31 中山东菱威力电器有限公司 Intelligent toilet lid control system capable of improving initial temperature of flushing water
CN116440340B (en) * 2023-04-27 2024-01-23 苏州鸿博医疗器械有限公司 Flushing drainage device and control system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101201605A (en) * 2007-12-07 2008-06-18 华中科技大学 System for monitoring and controlling medical transfusion speed based on machine vision
CN101505813A (en) * 2006-08-23 2009-08-12 B布劳恩阿维图姆公司 Medical device for extracorporeal blood treatment
CN101720024A (en) * 2009-11-23 2010-06-02 深圳市宾利达智能科技有限公司 Intelligent recognition monitoring system and monitoring method thereof
US20130010094A1 (en) * 2011-07-09 2013-01-10 Siddarth Satish System and method for estimating extracorporeal blood volume in a physical sample
CN103830791A (en) * 2012-11-27 2014-06-04 深圳先进技术研究院 Automatic peritoneal dialysis machine
CN104316527A (en) * 2014-11-07 2015-01-28 昆山韦睿医疗科技有限公司 Automatic detection method for discharged dialyzate, and automatic detection device for discharged dialyzate
CN108053872A (en) * 2017-12-27 2018-05-18 苏州麦迪斯顿医疗科技股份有限公司 A kind of harvester and its acquisition method of data of dialysing
CN109498857A (en) * 2018-12-29 2019-03-22 刘铁楠 A kind of drainage monitoring system and method based on image recognition

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100261980A1 (en) 2007-09-19 2010-10-14 Koninklijke Philips Electronics N.V. Method and apparatus for detecting an abnormal situation
US20090149776A1 (en) 2007-12-05 2009-06-11 Adams Scott C Optical sensor for detecting infection and other anomalous conditions associated with catheter systems
WO2011061746A1 (en) * 2009-11-20 2011-05-26 Given Imaging Ltd. System and method for controlling power consumption of an in vivo device
EP2850559B1 (en) * 2012-05-14 2021-02-24 Gauss Surgical, Inc. System and method for estimating a quantity of a blood component in a fluid canister
CN202751632U (en) * 2012-08-21 2013-02-27 张晓东 Automatic controlling device for external ventricular drainage under ceaseless monitor of intracranial pressure
US10321870B2 (en) 2014-05-01 2019-06-18 Ramot At Tel-Aviv University Ltd. Method and system for behavioral monitoring
TWI525578B (en) 2015-08-05 2016-03-11 國立清華大學 Image analysis method and apparatus for investigation of peritoneal dialysis complications in peritoneal dialysis
DE102016008332A1 (en) 2016-07-07 2018-01-11 Fresenius Medical Care Deutschland Gmbh Method for detecting symptoms of peritonitis
US11282602B2 (en) 2016-10-26 2022-03-22 Carefusion 2200, Inc. Device and method for mobile monitoring of drainage catheter
CN107497004A (en) * 2017-10-10 2017-12-22 西安汇智医疗集团有限公司 A kind of intelligent drainage of cerebrospinal fluid control and identification alarm system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101505813A (en) * 2006-08-23 2009-08-12 B布劳恩阿维图姆公司 Medical device for extracorporeal blood treatment
CN101201605A (en) * 2007-12-07 2008-06-18 华中科技大学 System for monitoring and controlling medical transfusion speed based on machine vision
CN101720024A (en) * 2009-11-23 2010-06-02 深圳市宾利达智能科技有限公司 Intelligent recognition monitoring system and monitoring method thereof
US20130010094A1 (en) * 2011-07-09 2013-01-10 Siddarth Satish System and method for estimating extracorporeal blood volume in a physical sample
CN103830791A (en) * 2012-11-27 2014-06-04 深圳先进技术研究院 Automatic peritoneal dialysis machine
CN104316527A (en) * 2014-11-07 2015-01-28 昆山韦睿医疗科技有限公司 Automatic detection method for discharged dialyzate, and automatic detection device for discharged dialyzate
CN108053872A (en) * 2017-12-27 2018-05-18 苏州麦迪斯顿医疗科技股份有限公司 A kind of harvester and its acquisition method of data of dialysing
CN109498857A (en) * 2018-12-29 2019-03-22 刘铁楠 A kind of drainage monitoring system and method based on image recognition

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115308101A (en) * 2022-09-27 2022-11-08 恒天益科技(深圳)有限公司 Water quality monitoring management method and system
CN117045884A (en) * 2023-10-11 2023-11-14 吉林医药学院 Drainage monitoring device for thoracic surgery
CN117045884B (en) * 2023-10-11 2023-12-26 吉林医药学院 Drainage monitoring device for thoracic surgery

Also Published As

Publication number Publication date
JP7211668B2 (en) 2023-01-24
JP2022516157A (en) 2022-02-24
CN109498857B (en) 2020-10-16
CN109498857A (en) 2019-03-22

Similar Documents

Publication Publication Date Title
WO2020135226A1 (en) Drainage monitoring system and method based on image recognition
CN103623480A (en) Bedside intelligent terminal service system for use in sickroom
CN206930346U (en) Real-time urine/body fluid monitoring system
CN103566436A (en) Method and system for infusion monitoring
CN105498042B (en) A kind of non-light-proof automatic alarm for infusion method and device thereof based on video
CN106651713A (en) Portable health management interactive device based on combination of medicine and health maintenance, and control method
CN103637811A (en) Medical dynamic urine volume detector
CN203634563U (en) Bedside intelligent terminal service system for wards
US20210316060A1 (en) Medical drainage monitoring method, apparatus, and system based on image recognition
CN206410732U (en) Ward environment and physiological parameters of patients monitoring system
US20220101977A1 (en) Intelligent Intracranial Hematoma Removal and Drainage System
CN215194492U (en) Intelligent infusion system
CN206193790U (en) Slow sick information -based system based on internet
CN113261926A (en) Hemodialysis patient home management method and system based on informatization technology
CN115252962A (en) Intelligent infusion alarm method and system based on machine vision
CN213155938U (en) Early warning monitor system for acute heart failure
CN204496497U (en) For the robot system of ward data acquisition
CN105999442A (en) Device for collecting operation waste liquid data and operation waste liquid
WO2017063149A1 (en) Multi-stage infusion alarm system and detection-side apparatus thereof
CN110507298A (en) Blood pressure monitor system and its monitoring method
CN103720478A (en) Medical urine flow detector
CN203693614U (en) Medical urine flow detecting instrument
CN214970342U (en) Infusion alarm with controllable dropping speed
CN204839449U (en) Thing networking monitor
CN110013574A (en) Drainage liquid amount real-time monitoring method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19902963

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021538480

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19902963

Country of ref document: EP

Kind code of ref document: A1