CN111175958A - Remote consultation method and system for pathological section under microscope - Google Patents
Remote consultation method and system for pathological section under microscope Download PDFInfo
- Publication number
- CN111175958A CN111175958A CN201911420078.8A CN201911420078A CN111175958A CN 111175958 A CN111175958 A CN 111175958A CN 201911420078 A CN201911420078 A CN 201911420078A CN 111175958 A CN111175958 A CN 111175958A
- Authority
- CN
- China
- Prior art keywords
- display terminal
- image information
- processor
- pathological
- pathological image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/361—Optical details, e.g. image relay to the camera or image sensor
Abstract
The invention relates to a remote consultation method for pathological sections under a microscope, which is suitable for a remote consultation system for pathological sections under a microscope, and comprises the following steps: the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor; the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal; the first processor and the second processor establish WebRTC connection; the second display terminal and the first display terminal synchronously display the pathological image information; when the pathological image information changes, the pictures on the first display terminal and the second display terminal change synchronously. The method combines the observation section under the microscope and the WebRTC technology, realizes the real-time sharing of the remote video/picture of the current field of the microscope, and solves the technical problem of poor timeliness and accuracy of remote consultation in the prior art.
Description
Technical Field
The invention relates to the field of medicine, in particular to a remote consultation method and system for pathological sections under a microscope.
Background
"pathology is the basis of medicine", and pathological examination is an extremely important diagnostic method, and is regarded as the gold standard for clinical diagnosis. At present, doctors mainly carry out manual interpretation on pathological sections under a microscope, which is a work with extremely high professional requirements, and the current domestic pathological talents are seriously insufficient. When a doctor looks over a pathological section, due to the fact that the level and the capacity are limited, a plurality of uncertain places are often formed, the doctor or a specialist needs to consult the doctor or the specialist, and due to the problems of time and distance, remote consultation becomes troublesome, the section cells are often disordered and complex, and the section cells are difficult to describe clearly only through telephone communication, so that one-sided diagnosis and diagnosis deviation are easily caused.
Disclosure of Invention
The present application is proposed to solve the above-mentioned technical problems. The embodiment of the application provides a remote consultation method and a system for pathological sections under a microscope, which are used for getting through space limitation, so that pathological doctors in different places can easily realize remote consultation.
According to an aspect of the present application, there is provided a remote consultation method for pathological sections under a microscope, which is suitable for a remote consultation system for pathological sections under a microscope, the system including a microscope, an image acquisition device, a first processor, a first display terminal, at least one second processor, and a second display terminal connected to the second processor, the image acquisition device being mounted on the microscope and being in communication connection with the first processor, the first processor being connected to the first display terminal, and the second processor being connected to the second display terminal, the remote consultation method including: the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor; the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal; the first processor and the second processor establish WebRTC connection; the second display terminal and the first display terminal synchronously display the pathological image information; when the pathological image information changes, the pictures on the first display terminal and the second display terminal change synchronously.
Further, when the picture on the first display terminal generates first annotation information, the first annotation information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
Further, the second processor is integrated with the second display terminal on the mobile terminal device.
Further, when the pathological image information changes, the first processor records a change track of the pathological image information, and the first display terminal and/or the second display terminal include two display windows, wherein the first window is used for displaying the pathological image information, and the second window is used for displaying the change track of the pathological image information.
Further, the first processor performs AI intelligent diagnosis on the received pathological image information, identifies suspicious information on the pathological image information, marks out suspicious regions on the pathological image information, and displays the suspicious regions on the first display terminal and the second display terminal;
and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
According to yet another aspect of the present application, there is provided a remote consultation system for microscopic pathological sections, including: a microscope for observing the solid section; the image acquisition device is arranged on the microscope and is used for acquiring pathological image information of the entity section under the microscope; the first processor is in communication connection with the image acquisition device and receives pathological image information from the image acquisition device; the first display terminal is connected with the first processor and used for presenting the pathological image information received by the first processor; the first display terminal and the microscope synchronously display pathological image information of the same part, and the first display terminal also comprises at least one second processor which is connected with the first processor in a WebRTC mode; and the second display terminal is connected with the second processor and is used for synchronously displaying the pathological image information with the first display terminal.
Further, when the picture on the first display terminal generates first annotation information, the first annotation information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
Further, the second processor is integrated with the second display terminal on the mobile terminal device.
Further, when the pathological image information changes, the first processor records a change track of the pathological image information, and the first display terminal and/or the second display terminal include two display windows, wherein the first window is used for displaying the pathological image information, and the second window is used for displaying the change track of the pathological image information.
Further, the first processor performs AI intelligent diagnosis on the received pathological image information, marks a suspicious region on the pathological image information, and displays the suspicious region on the first display terminal and the second display terminal; and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
Compared with the prior art, the method combines the observation section under the microscope and the WebRTC technology, realizes the real-time sharing of the remote video/picture of the current field of the microscope, and solves the technical problem of poor timeliness and accuracy of remote consultation in the prior art. The first processor can carry out AI intelligent diagnosis on the pathological section image, automatically mark out suspicious regions for the reference of a user, manually draw/mark the pathological section on the display terminal by the user, and other consultants can see the drawing/marking information.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing in more detail embodiments of the present application with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings, like reference numbers generally represent like parts or steps.
FIG. 1 is a schematic diagram of a main control device connection of a remote consultation system;
FIG. 2 is a schematic view of a screen on the first display terminal of FIG. 1;
fig. 3 is a schematic diagram of AI intelligent diagnosis on the first display terminal of fig. 1.
Detailed Description
Hereinafter, example embodiments of the present application will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and that the present application is not limited by the example embodiments described herein.
Summary of the application
When a doctor looks over a pathological section, due to the fact that the level and the capacity are limited, a plurality of uncertain places are often formed, the doctor or a specialist needs to consult the doctor or the specialist, and due to the problems of time and distance, remote consultation becomes troublesome, the section cells are often disordered and complex, and the section cells are difficult to describe clearly only through telephone communication, so that one-sided diagnosis and diagnosis deviation are easily caused. The traditional methods are to gather several pathological experts and study the pathological sections together, or to send the pathological sections to relevant experts and request the experts to give diagnostic opinions, or to convert the pathological sections into pathological images and send the pathological images to the pathological experts for diagnosis, and the traditional methods are all easy to cause the problems of poor timeliness and accuracy. With the current trend, people work with computers and mobile phones as almost indispensable tools, and do not have a method for solving the problems of timeliness and accuracy of pathological diagnosis by means of computers and mobile phones? Moreover, as for the mobile phone, many apps are installed on the mobile phone of each person, and various software on the computer is endless, so that for quickly and simply realizing remote connection, the other party invited to establish connection can simultaneously see the slice image in the current field of view of the microscope, thereby giving accurate diagnosis information or performing remote learning, which becomes a very significant thing.
Aiming at the technical problems, the method combines the observation section under the microscope with the WebRTC technology, realizes the real-time sharing of the remote video/picture of the current visual field of the microscope, solves the technical problems of poor timeliness and accuracy of remote consultation in the prior art, can be used for remote teaching or on-line teaching in the medical field, and replaces the prior picture or video teaching mode. WebRTC is dominated by Google and consists of a set of standards, protocols and JavaScript API, and is used for realizing audio, video and data sharing between browsers (end-to-end) or between browsers and mobile phone communication software. The WebRTC does not need to install any plug-in, and real-time communication can be changed into a standard function through a simple JavaScript API. At present, chrome, firefox, opera browsers, Android and ios systems gradually realize the support of the WebRTC technology. And in the WebRTC connection process, intermediate information exchange is carried out between the initiator and the receiver through the signaling server and the transfer server.
Having described the general principles of the present application, various non-limiting embodiments of the present application will now be described with reference to the accompanying drawings.
Exemplary System
A remote consultation system for microscopic pathological sections, as shown in fig. 1, comprising: the microscope comprises a microscope 10, an image acquisition device 20 installed on the microscope, a first processor 40, a first display terminal 30 connected with the first processor, at least one second processor and a second display terminal connected with the second processor. As shown in fig. 2, the first display terminal includes two display windows, a first window 32 is used for displaying the pathological image information, and a second window 31 is used for displaying the change track of the pathological image information. The first processor and the first display terminal adopt computer equipment and respectively correspond to the computer host and the computer display. The second processor and the corresponding second display terminal may be integrated on a mobile terminal device, such as a mobile phone, a pad, or a common computer device. The number of the second processors and the corresponding second display terminals may be determined according to the number of the consultants required to join.
The microscope 10 is used for observing the solid section, transmitting the pathological image information of the solid section currently under the microscope to the first processor 40 through the image acquisition device 20, and displaying on the first display terminal 30. The first processor 40 and the first display terminal 30 may be a conventional computer and display, or may be other integrated devices with image receiving, processing and displaying functions. The first processor 40 acts as a master and the second processor acts as an invitee to establish a WebRTC connection with the first processor. The first processor sends the picture information presented by the first display terminal 30 to the second processor through the WebRTC connection, presents the picture information on the second display terminal, and establishes a voice call with the second processor.
Exemplary method
A remote consultation method for pathological sections under a microscope is suitable for a remote consultation system for pathological sections under a microscope, and comprises the following steps:
the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor;
the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal;
the first processor and the second processor establish WebRTC connection;
the second display terminal and the first display terminal synchronously display the pathological image information, and when the picture on the first display terminal generates first label information, the first label information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
In combination with a specific application scenario, in implementation, the first processor and the first display terminal are connected with an image acquisition device on a microscope, and receive and display a pathological image of a solid section currently located under the microscope on the first display terminal. The method comprises the steps that a main control party (a first processor) and an invited party (a second processor) establish WebRTC connection, firstly, the main control party generates a consultation link, the consultation link is sent to communication software of the invited party, such as QQ and WeChat, the invited party, namely the invited party, finishes connection with the main control party by clicking the consultation link or pasting the consultation link to a computer browser, and at the moment, the same picture as that on a first display terminal of the main control party is displayed on a display picture of the invited party, namely sharing of pathological section images under a microscope is realized. After the consultation link is established, the main control party and the invited party can carry out voice implementation, and pictures on the display terminal can be labeled, so that both sides of the labeled contents can see. The first processor further performs AI intelligent diagnosis on the received pathological image information, identifies suspicious information on the pathological image information, automatically marks out suspicious regions on the pathological image information, displays the suspicious regions on the first display terminal and the second display terminal, and can be seen by operators positioned in front of the first display terminal and the second display terminal, as shown in fig. 3. If a party participating in the method is confused about a certain area, the method can also be used for drawing on the display terminal, other parties can also see the drawing area, and the parties can also manually clear the drawing lines.
When someone adjusts the microscope, the pathological image information changes, and the display pictures of the master control party and the invited party also change, that is, the pictures on the first display terminal and the second display terminal change synchronously, and the information marked on the last display picture also disappears. At the moment, the first processor records the change track of the pathological image information and presents the change track on the first display terminal and the second display terminal. The first processor and the second processor can also realize a mute operation, and if the environment of the invited party is noisy, other consultation doctors cannot be influenced after the mute operation, and a quiet consultation environment is kept.
It should also be noted that the components or steps may be broken down and/or re-combined in the systems and methods of the present application. These decompositions and/or recombinations are to be considered as equivalents of the present application. The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, the description is not intended to limit embodiments of the application to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.
Claims (10)
1. A remote consultation method for pathological sections under a microscope is suitable for a remote consultation system for pathological sections under the microscope, the system comprises a microscope, an image acquisition device, a first processor, a first display terminal, at least one second processor and a second display terminal connected with the second processor, the image acquisition device is installed on the microscope and is in communication connection with the first processor, the first processor is connected with the first display terminal, and the second processor is connected with the second display terminal, and the remote consultation method comprises the following steps:
the method comprises the steps that an image acquisition device acquires pathological image information of a pathological section under a microscope and transmits the pathological image information to a first processor;
the first processor receives pathological image information from the image acquisition device and displays the pathological image information on the first display terminal; the first processor and the second processor establish WebRTC connection; the second display terminal and the first display terminal synchronously display the pathological image information;
when the pathological image information changes, the pictures on the first display terminal and the second display terminal change synchronously.
2. The method according to claim 1, wherein when the first label information is generated on the screen of the first display terminal, the first label information is displayed on the second display terminal synchronously; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
3. The method for remote consultation of pathological sections under microscope according to claim 1 or 2, wherein said second processor is integrated with said second display terminal on a mobile terminal device.
4. The method for remote consultation of pathological sections under microscope according to claim 1, wherein when the pathological image information changes, the first processor records the change track of the pathological image information, and the first display terminal and/or the second display terminal includes two display windows, the first window is used for displaying the pathological image information, and the second window is used for displaying the change track of the pathological image information.
5. The method according to claim 2, wherein the first processor performs AI intelligent diagnosis on the received pathological image information, identifies suspicious information on pathological image information, marks suspicious regions on the pathological image information, and displays the suspicious regions on the first display terminal and the second display terminal; and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
6. A remote consultation system for microscopic pathological sections, comprising: a microscope for observing the solid section; the image acquisition device is arranged on the microscope and is used for acquiring pathological image information of the entity section under the microscope; the first processor is in communication connection with the image acquisition device and receives pathological image information from the image acquisition device; the first display terminal is connected with the first processor and used for presenting the pathological image information received by the first processor; the first display terminal and the microscope synchronously display pathological image information of the same part, and the first display terminal is characterized by further comprising at least one second processor which is connected with the first processor through WebRTC; and the second display terminal is connected with the second processor and is used for synchronously displaying the pathological image information with the first display terminal.
7. The system of claim 6, wherein when the first label information is generated on the screen of the first display terminal, the first label information is synchronously displayed on the second display terminal; and when the picture on the second display terminal generates second annotation information, the second annotation information is synchronously displayed on the first display terminal.
8. The system of claim 6, wherein the second processor is integrated with the second display terminal on a mobile terminal device.
9. The system of claim 6, wherein the first processor records a change track of the pathological image information when the pathological image information changes, and the first display terminal and/or the second display terminal comprises two display windows, a first window is used for displaying the pathological image information, and a second window is used for displaying the change track of the pathological image information.
10. The system of claim 7, wherein the first processor performs an AI intelligent diagnosis on the received pathological image information, marks a suspicious region on the pathological image information, and displays the suspicious region on the first display terminal and the second display terminal; and when the pathological image information on the first display terminal changes, the labeling of the suspicious region is cancelled.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911420078.8A CN111175958A (en) | 2019-12-31 | 2019-12-31 | Remote consultation method and system for pathological section under microscope |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911420078.8A CN111175958A (en) | 2019-12-31 | 2019-12-31 | Remote consultation method and system for pathological section under microscope |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111175958A true CN111175958A (en) | 2020-05-19 |
Family
ID=70623747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911420078.8A Pending CN111175958A (en) | 2019-12-31 | 2019-12-31 | Remote consultation method and system for pathological section under microscope |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111175958A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113542906A (en) * | 2021-07-20 | 2021-10-22 | 山东新一代信息产业技术研究院有限公司 | RTSP video-based webpage plug-in-free playing method |
| CN115407959A (en) * | 2022-11-01 | 2022-11-29 | 深圳市生强科技有限公司 | Display system and method for digital slicing |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102368283A (en) * | 2011-02-21 | 2012-03-07 | 麦克奥迪实业集团有限公司 | Digital slice-based digital remote pathological diagnosis system and method |
| US20130229625A1 (en) * | 2011-04-11 | 2013-09-05 | Shanghai Mediworks Precision Instruments Co. Ltd | Digital slit-lamp microscope system and method of electronic record and remote diagnosis |
| US20140085453A1 (en) * | 2012-09-25 | 2014-03-27 | Sony Corporation | Image display device and image display system |
| CN205923980U (en) * | 2016-06-07 | 2017-02-08 | 苏州网颢信息科技有限公司 | Micro - imaging system of digit based on multi -media remote diagnosis technique |
| CN108133501A (en) * | 2012-07-13 | 2018-06-08 | 索尼公司 | Show method, image processing apparatus and the computer storage media of pathological image |
| CN110007455A (en) * | 2018-08-21 | 2019-07-12 | 腾讯科技（深圳）有限公司 | Pathology microscope, display module, control method, device and storage medium |
| CN110197722A (en) * | 2019-05-31 | 2019-09-03 | 贵州精准健康数据有限公司 | AI-CPU system platform |
-
2019
- 2019-12-31 CN CN201911420078.8A patent/CN111175958A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102368283A (en) * | 2011-02-21 | 2012-03-07 | 麦克奥迪实业集团有限公司 | Digital slice-based digital remote pathological diagnosis system and method |
| US20130229625A1 (en) * | 2011-04-11 | 2013-09-05 | Shanghai Mediworks Precision Instruments Co. Ltd | Digital slit-lamp microscope system and method of electronic record and remote diagnosis |
| CN108133501A (en) * | 2012-07-13 | 2018-06-08 | 索尼公司 | Show method, image processing apparatus and the computer storage media of pathological image |
| US20140085453A1 (en) * | 2012-09-25 | 2014-03-27 | Sony Corporation | Image display device and image display system |
| CN205923980U (en) * | 2016-06-07 | 2017-02-08 | 苏州网颢信息科技有限公司 | Micro - imaging system of digit based on multi -media remote diagnosis technique |
| CN110007455A (en) * | 2018-08-21 | 2019-07-12 | 腾讯科技（深圳）有限公司 | Pathology microscope, display module, control method, device and storage medium |
| CN110197722A (en) * | 2019-05-31 | 2019-09-03 | 贵州精准健康数据有限公司 | AI-CPU system platform |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113542906A (en) * | 2021-07-20 | 2021-10-22 | 山东新一代信息产业技术研究院有限公司 | RTSP video-based webpage plug-in-free playing method |
| CN115407959A (en) * | 2022-11-01 | 2022-11-29 | 深圳市生强科技有限公司 | Display system and method for digital slicing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11638127B2 (en) | Electronic device for sharing data and method for controlling the same | |
| US20190114771A1 (en) | Method and apparatus for acquiring information | |
| US20180110398A1 (en) | Automated system for medical video recording and storage | |
| US20150019201A1 (en) | Real-time interpreting systems and methods | |
| Lin | Telecytology for rapid on-site evaluation: current status | |
| CN110890161A (en) | Ultrasonic remote real-time consultation system | |
| WO2021135626A1 (en) | Method and apparatus for selecting menu items, readable medium and electronic device | |
| CN104427293A (en) | Method and device for establishing video conference interface and video terminal | |
| US20130215214A1 (en) | System and method for managing avatarsaddressing a remote participant in a video conference | |
| CN111175958A (en) | Remote consultation method and system for pathological section under microscope | |
| Kanthraj | Classification and design of teledermatology practice: what dermatoses? Which technology to apply? | |
| EP3087549A1 (en) | User terminal for a telemedicine image service and control method thereof | |
| KR101099838B1 (en) | Remote a/s method using video phone call between computer and mobile phone | |
| US11464484B2 (en) | Systems and methods of establishing a communication session for live review of ultrasound scanning | |
| KR20210135949A (en) | Data sharing apparatus and control method thereof | |
| CN104427285B (en) | A kind of prompt message generation method and device | |
| CN107610763B (en) | AI interface platform, application method thereof and AI application system | |
| KR20080034579A (en) | Remote diagnosis & inspection system using digital camera in the on-line network | |
| Allen et al. | Practical aspects of telehealth: set‐up and preparation for video consultations | |
| CN111326263B (en) | Labeling track display method, labeling track display device, labeling track display equipment and computer-readable storage medium | |
| Bilgi et al. | Teleconsultation of coronary angiograms using smartphones and an audio/video conferencing application | |
| US20150149195A1 (en) | Web-based interactive radiographic study session and interface | |
| CN113972013A (en) | Remote multidisciplinary consultation system and remote multidisciplinary consultation method | |
| EP2446851A2 (en) | One touch button for operating room support | |
| CN112732457A (en) | Image transmission method, image transmission device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200519 |
|
| RJ01 | Rejection of invention patent application after publication |