CN110659558A - Automatic drip alarm device based on image recognition and implementation method thereof - Google Patents

Automatic drip alarm device based on image recognition and implementation method thereof Download PDF

Info

Publication number
CN110659558A
CN110659558A CN201910711988.5A CN201910711988A CN110659558A CN 110659558 A CN110659558 A CN 110659558A CN 201910711988 A CN201910711988 A CN 201910711988A CN 110659558 A CN110659558 A CN 110659558A
Authority
CN
China
Prior art keywords
image
drip
sample image
sampling
control terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910711988.5A
Other languages
Chinese (zh)
Inventor
颜成钢
许瑶江
宋家驹
杨淏博
孙垚棋
张继勇
张勇东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dianzi University
Hangzhou Electronic Science and Technology University
Original Assignee
Hangzhou Electronic Science and Technology University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Electronic Science and Technology University filed Critical Hangzhou Electronic Science and Technology University
Priority to CN201910711988.5A priority Critical patent/CN110659558A/en
Publication of CN110659558A publication Critical patent/CN110659558A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/10ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
    • G16H20/17ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients delivered via infusion or injection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Epidemiology (AREA)
  • Public Health (AREA)
  • Primary Health Care (AREA)
  • Medicinal Chemistry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Chemical & Material Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Infusion, Injection, And Reservoir Apparatuses (AREA)

Abstract

The invention discloses an automatic drip alarm device based on image recognition and an implementation method thereof. The invention comprises an infusion end, a control terminal and a console. The infusion end comprises a sample image, sampling equipment and wireless transmission equipment; the sample image and the sampling device are respectively arranged at two sides of the transfusion drip tube and are symmetrically arranged; the control terminal is provided with a database, a matching module and a wireless communication module; the control terminal matches the received image with a sample image in a database through a matching module, and if the matching is successful, a message is sent to a console through a wireless communication module; the control console is provided with a plurality of medical staff and can process in time according to the information received by the control console. The invention improves the accuracy of information, provides accurate and timely operation suggestions for medical personnel and ensures the order stability in the drip chamber.

Description

Automatic drip alarm device based on image recognition and implementation method thereof
Technical Field
The invention provides an automatic drip alarm device based on image recognition and an implementation method thereof.
Background
As time is less and less, many people hope to use the time to the maximum within a limited time, for example, in the process of infusion, many people are willing to sleep and rest for spending, but in order to prevent the infusion from being finished but not replaced in time, people are difficult to fully use the time. In order to solve the increasingly serious doctor and patient problems, the invention aiming at various problems in hospitals is developed as required.
In the prior infusion process, a patient needs to stare at the infusion bottle consciously, and the infusion bottle needs to be replaced by the patient or not, and then the patient walks to a nurse station for replacement. The whole process is not only for patients but also for nurses, and unnecessary troubles in time are caused by manual errors and the like. With the social trend of digitalization, convenience and rapid development of technologies such as image recognition and wireless transmission, a certain innovation should be made in the aspect of replacement process.
Considering that a person who is subjected to infusion is possibly in a tired and weak state, possibly in a sleeping state and the like in the process of infusion, and the infusion condition cannot be reflected to a nurse station in time; the ward is too much, and the manpower resources can not be satisfied. The invention solves the problem, and can communicate and process in time to process the drip status. The device can reasonably deal with the situations of pipe blockage, no liquid in the dropping bottle and the like.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: in order to solve the problems of untimely interaction and untimely processing of drip condition information between nurses and patients, an automatic drip alarm device based on image recognition and an implementation method thereof are provided.
The technical scheme adopted by the invention for solving the technical problems is as follows: the automatic drip alarm device based on image recognition comprises a transfusion end, a control terminal and a console.
The infusion end comprises a sample image, sampling equipment and wireless transmission equipment; the sample image and the sampling device are respectively arranged at two sides of the transfusion drip tube and are symmetrically arranged; the sampling equipment is a miniature camera with a storage function and is used for sampling a sample image on the other side of the infusion drip tube at fixed time; the wireless transmission equipment sends the sampled image to the control terminal;
the control terminal is provided with a database, a matching module and a wireless communication module; the control terminal extracts feature point information from the received image, matches the feature point information prestored in the sample image in the database through the matching module, and sends a message to the console through the wireless communication module if the matching is successful;
the control console is provided with a plurality of medical staff and can process in time according to the information received by the control console.
When the wireless transmission equipment sends the sampled image to the control terminal, the wireless transmission equipment also sends the unique serial number ID of the current wireless transmission equipment together, so that medical personnel in a subsequent control console can conveniently and directly check the serial number ID;
according to the actual requirement, each transfusion seat is provided with wireless transmission equipment with a unique serial number ID at the transfusion end; thereby facilitating the direct viewing of medical staff at the subsequent control console;
the control terminal firstly carries out SLAM-based restoration processing on the received image, then matches the restored result image with the sample image in the database, compares the matching result with a preset result, and sends a comparison result message to the console through the wireless communication module if the matching result is within the range of a set notification threshold;
a plurality of sample images are stored in the database;
an implementation method of automatic drip alarm equipment based on image recognition comprises the following steps:
step 1: the method comprises the following steps of setting a sample image capable of being accurately sensed at a transfusion end, wherein the sample image is preset and has detailed information, and the method comprises the following specific steps:
1-1, ambient brightness information to which a sample image is adapted;
1-2, feature point information which can be extracted under a set condition;
1-3, using the set detailed information as state information for generating alarm;
step 2: sampling a sample image by a miniature camera at the infusion end, and the specific process is as follows:
2-1, setting a sampling period, wherein the sampling period time is less than the time of the liquid flowing through the miniature camera;
2-2, adjusting the brightness in real time according to the change of the external environment;
and 2-3, sampling the sample image arranged on the corresponding side of the infusion drip tube by using the adapted brightness and the set sampling period to construct a picture set.
And step 3: judgment of drip state
And 3-1, receiving the picture from the infusion end by the control terminal, and carrying out graying and convolutional neural network processing on the received picture to restore the obtained picture.
Thereby achieving a real-time feedback state;
3-2, comparing the characteristic point information of the recovered real-time sampling picture with the characteristic point information of the sample image actually prestored in the control terminal database, and judging whether the liquid in the pipe is in a normal state or not according to the matching degree of the characteristic point information: if the matching degree result is in the set range and the characteristics of a certain same characteristic point of the front and back continuous N sampling pictures are consistent, directly sending a corresponding instruction to the console; otherwise, continuing to detect;
the judgment of the front and back continuous N sampling pictures is used for detecting the accuracy of judgment information, and the accuracy is possibly influenced because a plurality of bubbles or human errors exist in the drip.
The invention has the beneficial effects that:
the invention feeds back the external information in real time aiming at different external environments and improves the accuracy of the information. In the method, the camera sampling under the influence of external factors such as liquid shielding in the tube is analyzed, so that accurate and timely operation suggestions are provided for medical personnel, and the order stability in a drip chamber is ensured.
To above-mentioned actual conditions, it is different according to the liquid adulterant in the drip tube to propose one kind, draw the characteristic point of liquid, after liquid does not pass through the place that detects, send out the signal to nurse's platform through wireless transmission automatically, then in time handled by the nurse. The method can safely and efficiently maintain the order in the hospital and reduce the working pressure of medical workers. The traditional analysis method is mostly used for detecting liquid in a bottle, so that the technical content and the cost of the product are increased, and the feasibility is low. Or judging whether the drip is normal by using infrared rays to judge the drip speed. Considering the effect of the liquid droplet on refraction of infrared rays, etc., and when the liquid droplet is a colored liquid, the reliability will be greatly reduced.
Drawings
FIG. 1 is a schematic view of the present invention.
Detailed Description
The present invention will be described in further detail below with reference to the accompanying drawings and examples.
The invention provides a drip alarm based on image recognition, which detects an image passing through liquid in a calculation mode of a convolutional neural network through the incompleteness of the image under the conditions that light is transmitted in the liquid and blocked and the like, calculates the difference value of the two images through comparison with a set value, and sends an instruction to a console to realize wireless communication before doctors and patients when only deviation caused by a plastic pipe exists.
The automatic drip alarm device based on image recognition comprises a transfusion end, a control terminal and a console.
As shown in fig. 1, the infusion end comprises a sample image 1, a sampling device 2 and a wireless transmission device 3; the sample image 1 and the sampling device 2 are respectively arranged at two sides of the transfusion drip tube and are symmetrically arranged; the sampling device 2 is a micro camera with a storage function and is used for sampling the sample image 1 on the other side of the infusion drip tube at fixed time; the wireless transmission equipment sends the sampled image to the control terminal;
the control terminal is provided with a database, a matching module and a wireless communication module; the control terminal extracts feature point information from the received image, matches the feature point information prestored in the sample image in the database through the matching module, and sends a message to the console through the wireless communication module if the matching is successful;
the control console is provided with a plurality of medical staff and can process in time according to the information received by the control console.
When the wireless transmission equipment sends the sampled image to the control terminal, the wireless transmission equipment also sends the unique serial number ID of the current wireless transmission equipment together, so that medical personnel in a subsequent control console can conveniently and directly check the serial number ID;
according to the actual requirement, each transfusion seat is provided with wireless transmission equipment with a unique serial number ID at the transfusion end; thereby facilitating the direct viewing of medical staff at the subsequent control console;
the control terminal firstly carries out SLAM-based restoration processing on the received image, then matches the restored result image with the sample image in the database, compares the matching result with a preset result, and sends a comparison result message to the console through the wireless communication module if the matching result is within the range of a set notification threshold;
an implementation method of automatic drip alarm equipment based on image recognition comprises the following steps:
step 1: the method comprises the following steps of setting a sample image capable of being accurately sensed at a transfusion end, wherein the sample image is preset and has detailed information, and the method comprises the following specific steps:
1-1, ambient brightness information to which a sample image is adapted;
1-2, feature point information which can be extracted under a set condition;
1-3, using the set detailed information as state information for generating alarm;
step 2: sampling a sample image by a miniature camera at the infusion end, and the specific process is as follows:
2-1, setting a sampling period, wherein the sampling period time is less than the time of the liquid flowing through the miniature camera;
2-2, adjusting the brightness in real time according to the change of the external environment;
and 2-3, sampling the sample image arranged on the corresponding side of the infusion drip tube by using the adapted brightness and the set sampling period to construct a picture set.
And step 3: judgment of drip state
And 3-1, receiving the picture from the infusion end by the control terminal, and carrying out graying and convolutional neural network processing on the received picture to restore the obtained picture.
Thereby achieving a real-time feedback state;
3-2, comparing the characteristic point information of the recovered real-time sampling picture with the characteristic point information of the sample image actually prestored in the control terminal database, and judging whether the liquid in the pipe is in a normal state or not according to the matching degree of the characteristic point information: if the matching degree result is in the set range and the characteristics of a certain same characteristic point of the front and back continuous N sampling pictures are consistent, directly sending a corresponding instruction to the console; otherwise, continuing to detect;
the judgment of the front and back continuous N sampling pictures is used for detecting the accuracy of judgment information, and the accuracy is possibly influenced because a plurality of bubbles or human errors exist in the drip.

Claims (8)

1. The automatic drip alarm equipment based on image recognition is characterized by comprising an infusion end, a control terminal and a console;
the infusion end comprises a sample image, sampling equipment and wireless transmission equipment; the sample image and the sampling device are respectively arranged at two sides of the transfusion drip tube and are symmetrically arranged; the sampling equipment is a miniature camera with a storage function and is used for sampling a sample image on the other side of the infusion drip tube at fixed time; the wireless transmission equipment sends the sampled image to the control terminal;
the control terminal is provided with a database, a matching module and a wireless communication module; the control terminal extracts feature point information from the received image, matches the feature point information prestored in the sample image in the database through the matching module, and sends a message to the console through the wireless communication module if the matching is successful;
the control console is provided with a plurality of medical staff and can process in time according to the information received by the control console.
2. The automatic drip alarm device based on image recognition according to claim 1, wherein when the wireless transmission device sends the sampled image to the control terminal, the wireless transmission device also sends a unique serial number ID where the current wireless transmission device is located, so that the subsequent console medical staff can conveniently and directly view the serial number ID.
3. An image recognition-based drip autoalarm as claimed in claim 2, wherein the infusion end is provided with a wireless transmission device with a unique serial number ID for each infusion seat according to actual requirements; thereby facilitating direct viewing by medical personnel on the subsequent console.
4. The automatic drip alarm device based on image recognition as claimed in claim 1, 2 or 3, wherein the control terminal performs a SLAM-based recovery process on the received image, matches the recovered result image with the sample image in the database, compares the matching result with a preset result, and sends a comparison result message to the console through the wireless communication module if the comparison result is within a set notification threshold range.
5. The method of claim 4 for implementing an image recognition-based drip automatic alarm device, comprising the steps of:
step 1: setting a sample image which can be accurately sensed at the infusion end, wherein the sample image is preset and has detailed characteristic point information;
step 2: sampling a sample image by a miniature camera at the infusion end;
and step 3: and the control terminal judges the state of the drip to obtain a result.
6. The method for implementing an automatic drip alarm device based on image recognition according to claim 5, wherein the step 1 is implemented as follows:
the characteristic point information comprises:
ambient brightness information to which the sample image is adapted;
the characteristic points can be extracted under the set conditions.
7. The method for implementing an image recognition-based drip automatic alarm device according to claim 6, wherein the step 2 is implemented as follows:
2-1, setting a sampling period, wherein the sampling period time is less than the time of the liquid flowing through the miniature camera;
2-2, adjusting the brightness in real time according to the change of the external environment;
and 2-3, sampling the sample image arranged on the corresponding side of the infusion drip tube by using the adapted brightness and the set sampling period to construct a picture set.
8. The method for implementing an image recognition-based drip automatic alarm device according to claim 7, wherein the step 3 is implemented as follows:
3-1, the control terminal receives the picture from the infusion end, and carries out graying and convolutional neural network processing on the received picture so as to restore the obtained picture;
3-2, comparing the characteristic point information of the recovered real-time sampling picture with the characteristic point information of the sample image actually prestored in the control terminal database, and judging whether the liquid in the pipe is in a normal state or not according to the matching degree of the characteristic point information: if the matching degree result is in the set range and the characteristics of a certain same characteristic point of the front and back continuous N sampling pictures are consistent, directly sending a corresponding instruction to the console; otherwise, the detection is continued.
CN201910711988.5A 2019-08-02 2019-08-02 Automatic drip alarm device based on image recognition and implementation method thereof Pending CN110659558A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910711988.5A CN110659558A (en) 2019-08-02 2019-08-02 Automatic drip alarm device based on image recognition and implementation method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910711988.5A CN110659558A (en) 2019-08-02 2019-08-02 Automatic drip alarm device based on image recognition and implementation method thereof

Publications (1)

Publication Number Publication Date
CN110659558A true CN110659558A (en) 2020-01-07

Family

ID=69036877

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910711988.5A Pending CN110659558A (en) 2019-08-02 2019-08-02 Automatic drip alarm device based on image recognition and implementation method thereof

Country Status (1)

Country Link
CN (1) CN110659558A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101201605A (en) * 2007-12-07 2008-06-18 华中科技大学 System for monitoring and controlling medical transfusion speed based on machine vision
CN201379841Y (en) * 2008-06-26 2010-01-13 吴秀华 Networked video and audio monitoring system for transfusion
CN201969115U (en) * 2011-02-28 2011-09-14 南京信息工程大学 Clinic infusion alarm system
CN202223641U (en) * 2011-09-02 2012-05-23 上海大学 Intelligent safe transfusion system
CN103127583A (en) * 2013-03-19 2013-06-05 南京理工大学 Transfusion monitoring device based on video images
US20130310990A1 (en) * 2011-12-21 2013-11-21 Deka Products Limited Partnership System, Method, and Apparatus for Monitoring, Regulating, or Controlling Fluid Flow
CN204411420U (en) * 2015-01-01 2015-06-24 薛长国 A kind of infusion alarm
US20160055649A1 (en) * 2011-12-21 2016-02-25 Deka Products Limited Partnership Flow meter and related system and apparatus
CN105983156A (en) * 2015-03-02 2016-10-05 顾莹 Infusion support with background plate
CN108444574A (en) * 2018-03-30 2018-08-24 南京理工大学 A kind of device measuring liquid level using image analysis technology

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101201605A (en) * 2007-12-07 2008-06-18 华中科技大学 System for monitoring and controlling medical transfusion speed based on machine vision
CN201379841Y (en) * 2008-06-26 2010-01-13 吴秀华 Networked video and audio monitoring system for transfusion
CN201969115U (en) * 2011-02-28 2011-09-14 南京信息工程大学 Clinic infusion alarm system
CN202223641U (en) * 2011-09-02 2012-05-23 上海大学 Intelligent safe transfusion system
US20130310990A1 (en) * 2011-12-21 2013-11-21 Deka Products Limited Partnership System, Method, and Apparatus for Monitoring, Regulating, or Controlling Fluid Flow
US20160055649A1 (en) * 2011-12-21 2016-02-25 Deka Products Limited Partnership Flow meter and related system and apparatus
CN103127583A (en) * 2013-03-19 2013-06-05 南京理工大学 Transfusion monitoring device based on video images
CN204411420U (en) * 2015-01-01 2015-06-24 薛长国 A kind of infusion alarm
CN105983156A (en) * 2015-03-02 2016-10-05 顾莹 Infusion support with background plate
CN108444574A (en) * 2018-03-30 2018-08-24 南京理工大学 A kind of device measuring liquid level using image analysis technology

Non-Patent Citations (8)

* Cited by examiner, † Cited by third party
Title
CHANGSHENG ZHANG ET AL.: "Research on water level gauge image identification based on intelligent remote viewing", 《2016 CHINESE CONTROL AND DECISION CONFERENCE (CCDC)》 *
J. GONZALEZ-LINARES ET AL.: "An efficient image processing algorithm for high-level skill acquisition", 《PROCEEDINGS OF THE 1999 IEEE INTERNATIONAL SYMPOSIUM ON ASSEMBLY AND TASK PLANNING (ISATP"99) (CAT. NO.99TH8470)》 *
SOURABH SURESH ALAGUNDAGI ET AL.: "Opto-electronic system for intravenous infusion monitoring", 《2018 10TH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS & NETWORKS (COMSNETS)》 *
李文静: "静脉输液报警装置中液位信号的检测原理", 《电子设计工程》 *
许晓荣 等: "基于物联网技术的智能输液室监控系统的研究", 《生命科学仪器》 *
阮太元: "医院病房静脉输液监测系统", 《电子技术与软件工程》 *
韩晓微 等: "《药材中红色黄金 西红花》" *
黄越 等: "基于视频图像的输液滴速实时监测系统", 《数据采集与处理》 *

Similar Documents

Publication Publication Date Title
US11701282B2 (en) Relocation module and methods for surgical equipment
US11648166B2 (en) Relocation module and methods for surgical equipment
US11426320B2 (en) Relocation module and methods for surgical equipment
US20220183915A1 (en) Relocation module and methods for surgical equipment
CN106620955A (en) Infusion reminding method and infusion reminding system
US20140337045A1 (en) Remote Notification System
CN107137801A (en) A kind of transfusion monitoring system and method that the frequency is read based on ultrahigh frequency RFID
Rosdi et al. A smart infusion pump system for remote management and monitoring of intravenous (IV) drips
EP3437014A1 (en) Monitoring compliance with medical protocols based on occlusion of line of sight
CN110348431A (en) A kind of disease pre-warning method, device, equipment and system
CN108096666A (en) A kind of transfusion monitoring system based on wearable device
US20220223249A1 (en) System and method for reduced infusion administration line error
Hwang et al. Deep learning-based monitoring technique for real-time intravenous medication bag status
CN110659558A (en) Automatic drip alarm device based on image recognition and implementation method thereof
CN103714368B (en) A kind of information processing method, apparatus and system
US20230062332A1 (en) Image-based pairing and controlling of devices in a clinical environment
CN115732067A (en) Bedside infusion entity checking system and method based on computer vision
WO2016192162A1 (en) Smart nursing reminder method, nursing end device, and smart nursing system
CN107137800A (en) Fuction monitoring device for infusion and monitoring method
CN215194492U (en) Intelligent infusion system
CN114900806A (en) Internet of things intensive care system
Sonkar et al. Smart Intravenous Drip Monitoring System with Bubble Detection Indicator using IoT
CN105657020A (en) Remote physical sign data acquisition apparatus
CN105662347B (en) A kind of monitoring of parahypnosis and alarm method
CN209361527U (en) Drop monitoring system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200107

RJ01 Rejection of invention patent application after publication