CN111175958A - Remote consultation method and system for pathological section under microscope - Google Patents

Remote consultation method and system for pathological section under microscope Download PDF

Info

Publication number
CN111175958A
CN111175958A CN201911420078.8A CN201911420078A CN111175958A CN 111175958 A CN111175958 A CN 111175958A CN 201911420078 A CN201911420078 A CN 201911420078A CN 111175958 A CN111175958 A CN 111175958A
Authority
CN
China
Prior art keywords
display terminal
image information
processor
pathological
pathological image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911420078.8A
Other languages
Chinese (zh)
Inventor
沈珏伟
孙秋艳
杨林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Diyingjia Technology Co ltd
Original Assignee
Hangzhou Diyingjia Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Diyingjia Technology Co ltd filed Critical Hangzhou Diyingjia Technology Co ltd
Priority to CN201911420078.8A priority Critical patent/CN111175958A/en
Publication of CN111175958A publication Critical patent/CN111175958A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/361Optical details, e.g. image relay to the camera or image sensor

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The invention relates to a remote consultation method for pathological sections under a microscope, which is suitable for a remote consultation system for pathological sections under a microscope, and comprises the following steps: the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor; the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal; the first processor and the second processor establish WebRTC connection; the second display terminal and the first display terminal synchronously display the pathological image information; when the pathological image information changes, the pictures on the first display terminal and the second display terminal change synchronously. The method combines the observation section under the microscope and the WebRTC technology, realizes the real-time sharing of the remote video/picture of the current field of the microscope, and solves the technical problem of poor timeliness and accuracy of remote consultation in the prior art.

Description

Remote consultation method and system for pathological section under microscope
Technical Field
The invention relates to the field of medicine, in particular to a remote consultation method and system for pathological sections under a microscope.
Background
"pathology is the basis of medicine", and pathological examination is an extremely important diagnostic method, and is regarded as the gold standard for clinical diagnosis. At present, doctors mainly carry out manual interpretation on pathological sections under a microscope, which is a work with extremely high professional requirements, and the current domestic pathological talents are seriously insufficient. When a doctor looks over a pathological section, due to the fact that the level and the capacity are limited, a plurality of uncertain places are often formed, the doctor or a specialist needs to consult the doctor or the specialist, and due to the problems of time and distance, remote consultation becomes troublesome, the section cells are often disordered and complex, and the section cells are difficult to describe clearly only through telephone communication, so that one-sided diagnosis and diagnosis deviation are easily caused.
Disclosure of Invention
The present application is proposed to solve the above-mentioned technical problems. The embodiment of the application provides a remote consultation method and a system for pathological sections under a microscope, which are used for getting through space limitation, so that pathological doctors in different places can easily realize remote consultation.
According to an aspect of the present application, there is provided a remote consultation method for pathological sections under a microscope, which is suitable for a remote consultation system for pathological sections under a microscope, the system including a microscope, an image acquisition device, a first processor, a first display terminal, at least one second processor, and a second display terminal connected to the second processor, the image acquisition device being mounted on the microscope and being in communication connection with the first processor, the first processor being connected to the first display terminal, and the second processor being connected to the second display terminal, the remote consultation method including: the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor; the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal; the first processor and the second processor establish WebRTC connection; the second display terminal and the first display terminal synchronously display the pathological image information; when the pathological image information changes, the pictures on the first display terminal and the second display terminal change synchronously.
Further, when the picture on the first display terminal generates first annotation information, the first annotation information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
Further, the second processor is integrated with the second display terminal on the mobile terminal device.
Further, when the pathological image information changes, the first processor records a change track of the pathological image information, and the first display terminal and/or the second display terminal include two display windows, wherein the first window is used for displaying the pathological image information, and the second window is used for displaying the change track of the pathological image information.
Further, the first processor performs AI intelligent diagnosis on the received pathological image information, identifies suspicious information on the pathological image information, marks out suspicious regions on the pathological image information, and displays the suspicious regions on the first display terminal and the second display terminal;
and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
According to yet another aspect of the present application, there is provided a remote consultation system for microscopic pathological sections, including: a microscope for observing the solid section; the image acquisition device is arranged on the microscope and is used for acquiring pathological image information of the entity section under the microscope; the first processor is in communication connection with the image acquisition device and receives pathological image information from the image acquisition device; the first display terminal is connected with the first processor and used for presenting the pathological image information received by the first processor; the first display terminal and the microscope synchronously display pathological image information of the same part, and the first display terminal also comprises at least one second processor which is connected with the first processor in a WebRTC mode; and the second display terminal is connected with the second processor and is used for synchronously displaying the pathological image information with the first display terminal.
Further, when the picture on the first display terminal generates first annotation information, the first annotation information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
Further, the second processor is integrated with the second display terminal on the mobile terminal device.
Further, when the pathological image information changes, the first processor records a change track of the pathological image information, and the first display terminal and/or the second display terminal include two display windows, wherein the first window is used for displaying the pathological image information, and the second window is used for displaying the change track of the pathological image information.
Further, the first processor performs AI intelligent diagnosis on the received pathological image information, marks a suspicious region on the pathological image information, and displays the suspicious region on the first display terminal and the second display terminal; and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
Compared with the prior art, the method combines the observation section under the microscope and the WebRTC technology, realizes the real-time sharing of the remote video/picture of the current field of the microscope, and solves the technical problem of poor timeliness and accuracy of remote consultation in the prior art. The first processor can carry out AI intelligent diagnosis on the pathological section image, automatically mark out suspicious regions for the reference of a user, manually draw/mark the pathological section on the display terminal by the user, and other consultants can see the drawing/marking information.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing in more detail embodiments of the present application with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings, like reference numbers generally represent like parts or steps.
FIG. 1 is a schematic diagram of a main control device connection of a remote consultation system;
FIG. 2 is a schematic view of a screen on the first display terminal of FIG. 1;
fig. 3 is a schematic diagram of AI intelligent diagnosis on the first display terminal of fig. 1.
Detailed Description
Hereinafter, example embodiments of the present application will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and that the present application is not limited by the example embodiments described herein.
Summary of the application
When a doctor looks over a pathological section, due to the fact that the level and the capacity are limited, a plurality of uncertain places are often formed, the doctor or a specialist needs to consult the doctor or the specialist, and due to the problems of time and distance, remote consultation becomes troublesome, the section cells are often disordered and complex, and the section cells are difficult to describe clearly only through telephone communication, so that one-sided diagnosis and diagnosis deviation are easily caused. The traditional methods are to gather several pathological experts and study the pathological sections together, or to send the pathological sections to relevant experts and request the experts to give diagnostic opinions, or to convert the pathological sections into pathological images and send the pathological images to the pathological experts for diagnosis, and the traditional methods are all easy to cause the problems of poor timeliness and accuracy. With the current trend, people work with computers and mobile phones as almost indispensable tools, and do not have a method for solving the problems of timeliness and accuracy of pathological diagnosis by means of computers and mobile phones? Moreover, as for the mobile phone, many apps are installed on the mobile phone of each person, and various software on the computer is endless, so that for quickly and simply realizing remote connection, the other party invited to establish connection can simultaneously see the slice image in the current field of view of the microscope, thereby giving accurate diagnosis information or performing remote learning, which becomes a very significant thing.
Aiming at the technical problems, the method combines the observation section under the microscope with the WebRTC technology, realizes the real-time sharing of the remote video/picture of the current visual field of the microscope, solves the technical problems of poor timeliness and accuracy of remote consultation in the prior art, can be used for remote teaching or on-line teaching in the medical field, and replaces the prior picture or video teaching mode. WebRTC is dominated by Google and consists of a set of standards, protocols and JavaScript API, and is used for realizing audio, video and data sharing between browsers (end-to-end) or between browsers and mobile phone communication software. The WebRTC does not need to install any plug-in, and real-time communication can be changed into a standard function through a simple JavaScript API. At present, chrome, firefox, opera browsers, Android and ios systems gradually realize the support of the WebRTC technology. And in the WebRTC connection process, intermediate information exchange is carried out between the initiator and the receiver through the signaling server and the transfer server.
Having described the general principles of the present application, various non-limiting embodiments of the present application will now be described with reference to the accompanying drawings.
Exemplary System
A remote consultation system for microscopic pathological sections, as shown in fig. 1, comprising: the microscope comprises a microscope 10, an image acquisition device 20 installed on the microscope, a first processor 40, a first display terminal 30 connected with the first processor, at least one second processor and a second display terminal connected with the second processor. As shown in fig. 2, the first display terminal includes two display windows, a first window 32 is used for displaying the pathological image information, and a second window 31 is used for displaying the change track of the pathological image information. The first processor and the first display terminal adopt computer equipment and respectively correspond to the computer host and the computer display. The second processor and the corresponding second display terminal may be integrated on a mobile terminal device, such as a mobile phone, a pad, or a common computer device. The number of the second processors and the corresponding second display terminals may be determined according to the number of the consultants required to join.
The microscope 10 is used for observing the solid section, transmitting the pathological image information of the solid section currently under the microscope to the first processor 40 through the image acquisition device 20, and displaying on the first display terminal 30. The first processor 40 and the first display terminal 30 may be a conventional computer and display, or may be other integrated devices with image receiving, processing and displaying functions. The first processor 40 acts as a master and the second processor acts as an invitee to establish a WebRTC connection with the first processor. The first processor sends the picture information presented by the first display terminal 30 to the second processor through the WebRTC connection, presents the picture information on the second display terminal, and establishes a voice call with the second processor.
Exemplary method
A remote consultation method for pathological sections under a microscope is suitable for a remote consultation system for pathological sections under a microscope, and comprises the following steps:
the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor;
the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal;
the first processor and the second processor establish WebRTC connection;
the second display terminal and the first display terminal synchronously display the pathological image information, and when the picture on the first display terminal generates first label information, the first label information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
In combination with a specific application scenario, in implementation, the first processor and the first display terminal are connected with an image acquisition device on a microscope, and receive and display a pathological image of a solid section currently located under the microscope on the first display terminal. The method comprises the steps that a main control party (a first processor) and an invited party (a second processor) establish WebRTC connection, firstly, the main control party generates a consultation link, the consultation link is sent to communication software of the invited party, such as QQ and WeChat, the invited party, namely the invited party, finishes connection with the main control party by clicking the consultation link or pasting the consultation link to a computer browser, and at the moment, the same picture as that on a first display terminal of the main control party is displayed on a display picture of the invited party, namely sharing of pathological section images under a microscope is realized. After the consultation link is established, the main control party and the invited party can carry out voice implementation, and pictures on the display terminal can be labeled, so that both sides of the labeled contents can see. The first processor further performs AI intelligent diagnosis on the received pathological image information, identifies suspicious information on the pathological image information, automatically marks out suspicious regions on the pathological image information, displays the suspicious regions on the first display terminal and the second display terminal, and can be seen by operators positioned in front of the first display terminal and the second display terminal, as shown in fig. 3. If a party participating in the method is confused about a certain area, the method can also be used for drawing on the display terminal, other parties can also see the drawing area, and the parties can also manually clear the drawing lines.
When someone adjusts the microscope, the pathological image information changes, and the display pictures of the master control party and the invited party also change, that is, the pictures on the first display terminal and the second display terminal change synchronously, and the information marked on the last display picture also disappears. At the moment, the first processor records the change track of the pathological image information and presents the change track on the first display terminal and the second display terminal. The first processor and the second processor can also realize a mute operation, and if the environment of the invited party is noisy, other consultation doctors cannot be influenced after the mute operation, and a quiet consultation environment is kept.
It should also be noted that the components or steps may be broken down and/or re-combined in the systems and methods of the present application. These decompositions and/or recombinations are to be considered as equivalents of the present application. The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.

Claims (10)

1. A remote consultation method for pathological sections under a microscope is suitable for a remote consultation system for pathological sections under the microscope, the system comprises a microscope, an image acquisition device, a first processor, a first display terminal, at least one second processor and a second display terminal connected with the second processor, the image acquisition device is installed on the microscope and is in communication connection with the first processor, the first processor is connected with the first display terminal, and the second processor is connected with the second display terminal, and the remote consultation method comprises the following steps:
the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor;
the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal; the first processor and the second processor establish WebRTC connection; the second display terminal and the first display terminal synchronously display the pathological image information;
when the pathological image information changes, the pictures on the first display terminal and the second display terminal change synchronously.
2. The method according to claim 1, wherein when the first label information is generated on the screen of the first display terminal, the first label information is displayed on the second display terminal synchronously; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
3. The method for remote consultation of pathological sections under microscope according to claim 1 or 2, wherein said second processor is integrated with said second display terminal on a mobile terminal device.
4. The method for remote consultation of pathological sections under microscope according to claim 1, wherein when the pathological image information changes, the first processor records the change track of the pathological image information, and the first display terminal and/or the second display terminal includes two display windows, the first window is used for displaying the pathological image information, and the second window is used for displaying the change track of the pathological image information.
5. The method according to claim 2, wherein the first processor performs AI intelligent diagnosis on the received pathological image information, identifies suspicious information on pathological image information, marks suspicious regions on the pathological image information, and displays the suspicious regions on the first display terminal and the second display terminal; and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
6. A remote consultation system for microscopic pathological sections, comprising: a microscope for observing the solid section; the image acquisition device is arranged on the microscope and is used for acquiring pathological image information of the entity section under the microscope; the first processor is in communication connection with the image acquisition device and receives pathological image information from the image acquisition device; the first display terminal is connected with the first processor and used for presenting the pathological image information received by the first processor; the first display terminal and the microscope synchronously display pathological image information of the same part, and the first display terminal is characterized by further comprising at least one second processor which is connected with the first processor through WebRTC; and the second display terminal is connected with the second processor and is used for synchronously displaying the pathological image information with the first display terminal.
7. The system of claim 6, wherein when the first label information is generated on the screen of the first display terminal, the first label information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
8. The system of claim 6, wherein the second processor is integrated with the second display terminal on a mobile terminal device.
9. The system of claim 6, wherein the first processor records a change track of the pathological image information when the pathological image information changes, and the first display terminal and/or the second display terminal comprises two display windows, a first window is used for displaying the pathological image information, and a second window is used for displaying the change track of the pathological image information.
10. The system of claim 7, wherein the first processor performs an AI intelligent diagnosis on the received pathological image information, marks a suspicious region on the pathological image information, and displays the suspicious region on the first display terminal and the second display terminal; and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
CN201911420078.8A 2019-12-31 2019-12-31 Remote consultation method and system for pathological section under microscope Pending CN111175958A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911420078.8A CN111175958A (en) 2019-12-31 2019-12-31 Remote consultation method and system for pathological section under microscope

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911420078.8A CN111175958A (en) 2019-12-31 2019-12-31 Remote consultation method and system for pathological section under microscope

Publications (1)

Publication Number Publication Date
CN111175958A true CN111175958A (en) 2020-05-19

Family

ID=70623747

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911420078.8A Pending CN111175958A (en) 2019-12-31 2019-12-31 Remote consultation method and system for pathological section under microscope

Country Status (1)

Country Link
CN (1) CN111175958A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113542906A (en) * 2021-07-20 2021-10-22 山东新一代信息产业技术研究院有限公司 RTSP video-based webpage plug-in-free playing method
CN115407959A (en) * 2022-11-01 2022-11-29 深圳市生强科技有限公司 Display system and method for digital slicing
CN118737426A (en) * 2024-09-02 2024-10-01 深圳市生强科技有限公司 Multi-screen synchronous operation method and device based on pathological section images

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102368283A (en) * 2011-02-21 2012-03-07 麦克奥迪实业集团有限公司 Digital slice-based digital remote pathological diagnosis system and method
US20130229625A1 (en) * 2011-04-11 2013-09-05 Shanghai Mediworks Precision Instruments Co. Ltd Digital slit-lamp microscope system and method of electronic record and remote diagnosis
US20140085453A1 (en) * 2012-09-25 2014-03-27 Sony Corporation Image display device and image display system
CN205923980U (en) * 2016-06-07 2017-02-08 苏州网颢信息科技有限公司 Micro - imaging system of digit based on multi -media remote diagnosis technique
CN108133501A (en) * 2012-07-13 2018-06-08 索尼公司 Show method, image processing apparatus and the computer storage media of pathological image
CN110007455A (en) * 2018-08-21 2019-07-12 腾讯科技(深圳)有限公司 Pathology microscope, display module, control method, device and storage medium
CN110197722A (en) * 2019-05-31 2019-09-03 贵州精准健康数据有限公司 AI-CPU system platform

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102368283A (en) * 2011-02-21 2012-03-07 麦克奥迪实业集团有限公司 Digital slice-based digital remote pathological diagnosis system and method
US20130229625A1 (en) * 2011-04-11 2013-09-05 Shanghai Mediworks Precision Instruments Co. Ltd Digital slit-lamp microscope system and method of electronic record and remote diagnosis
CN108133501A (en) * 2012-07-13 2018-06-08 索尼公司 Show method, image processing apparatus and the computer storage media of pathological image
US20140085453A1 (en) * 2012-09-25 2014-03-27 Sony Corporation Image display device and image display system
CN205923980U (en) * 2016-06-07 2017-02-08 苏州网颢信息科技有限公司 Micro - imaging system of digit based on multi -media remote diagnosis technique
CN110007455A (en) * 2018-08-21 2019-07-12 腾讯科技(深圳)有限公司 Pathology microscope, display module, control method, device and storage medium
CN110197722A (en) * 2019-05-31 2019-09-03 贵州精准健康数据有限公司 AI-CPU system platform

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113542906A (en) * 2021-07-20 2021-10-22 山东新一代信息产业技术研究院有限公司 RTSP video-based webpage plug-in-free playing method
CN115407959A (en) * 2022-11-01 2022-11-29 深圳市生强科技有限公司 Display system and method for digital slicing
CN118737426A (en) * 2024-09-02 2024-10-01 深圳市生强科技有限公司 Multi-screen synchronous operation method and device based on pathological section images

Similar Documents

Publication Publication Date Title
CN111175958A (en) Remote consultation method and system for pathological section under microscope
US11871307B2 (en) Electronic device for sharing data and method for controlling the same
US20190114771A1 (en) Method and apparatus for acquiring information
US20150019201A1 (en) Real-time interpreting systems and methods
Lin Telecytology for rapid on-site evaluation: current status
US11464484B2 (en) Systems and methods of establishing a communication session for live review of ultrasound scanning
CN104427293A (en) Method and device for establishing video conference interface and video terminal
CN106302395A (en) A kind of audio frequency and video diagnosis and treatment method based on multicast communication and system
KR101099838B1 (en) Remote a/s method using video phone call between computer and mobile phone
US20130215214A1 (en) System and method for managing avatarsaddressing a remote participant in a video conference
Kanthraj Classification and design of teledermatology practice: what dermatoses? Which technology to apply?
KR20210135949A (en) Data sharing apparatus and control method thereof
Sirintrapun et al. Successful secure high-definition streaming telecytology for remote cytologic evaluation
CN118170852B (en) Structured data synchronization method and system
CN104427285B (en) A kind of prompt message generation method and device
US20150149195A1 (en) Web-based interactive radiographic study session and interface
CN107610763B (en) AI interface platform, application method thereof and AI application system
CA2879378A1 (en) System and method for management of patients and critical information
CN111326263B (en) Labeling track display method, labeling track display device, labeling track display equipment and computer-readable storage medium
Bilgi et al. Teleconsultation of coronary angiograms using smartphones and an audio/video conferencing application
CN111883233A (en) Image acquisition method and device, electronic equipment and storage medium
CN215770538U (en) Augmented reality system for remote consultation
CN111128404A (en) Remote consultation device, method and system
CN114155979A (en) Picture display control method and equipment and remote consultation system
EP2446851A2 (en) One touch button for operating room support

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200519

RJ01 Rejection of invention patent application after publication