CN115407959A - Display system and method for digital slicing - Google Patents
Display system and method for digital slicing Download PDFInfo
- Publication number
- CN115407959A CN115407959A CN202211353915.1A CN202211353915A CN115407959A CN 115407959 A CN115407959 A CN 115407959A CN 202211353915 A CN202211353915 A CN 202211353915A CN 115407959 A CN115407959 A CN 115407959A
- Authority
- CN
- China
- Prior art keywords
- display
- display device
- slice
- configuration
- observation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000004891 communication Methods 0.000 claims description 22
- 238000010186 staining Methods 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 7
- 238000013459 approach Methods 0.000 claims description 3
- 238000004590 computer program Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 14
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 230000001575 pathological effect Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 239000011521 glass Substances 0.000 description 5
- 230000003902 lesion Effects 0.000 description 4
- 238000010827 pathological analysis Methods 0.000 description 4
- 238000004171 remote diagnosis Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010801 machine learning Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 206010020675 Hypermetropia Diseases 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000004305 hyperopia Effects 0.000 description 1
- 201000006318 hyperopia Diseases 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 208000001491 myopia Diseases 0.000 description 1
- 230000004379 myopia Effects 0.000 description 1
- 230000007170 pathology Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The application provides a display system and method for digital slicing. The display system includes: a first display device for performing slice image display according to a first display configuration so as to simulate an observation result on an observation apparatus of a slice corresponding to an image displayed by the first display device; at least one second display device in one-to-one correspondence with at least one second display configuration, each second display device being configured to perform slice image display according to the second display configuration of the second display device such that a display result of an image displayed by the second display device on the second display device approximates a display result of the image on the first display device in accordance with the first display configuration for slice image display, and the second display configuration of the second display device being based on a difference between the second display device and the first display configuration. Thus, the digital slice browsing experience is improved.
Description
Technical Field
The application relates to the technical field of internet, in particular to the technical field of data processing, and specifically relates to a display system and method for digital slicing.
Background
In the field of application of medical observation and pathological analysis, a tissue slice is cut from a living body such as a suspicious lesion of a human body by an operation or the like and fixed on a surface of a glass slide for staining to prepare a section, also called a tissue section or a pathological section, and then the prepared section is observed under an optical microscope or an electron microscope to obtain a structural feature, to perform pathological analysis, or the like. The full field digital image (WSI) refers to a digitized virtual slice generated by performing omnidirectional full-information fast scanning imaging on a whole glass slide of a traditional real glass slide, namely a real slice. The digital slice has the characteristics of ultra-large storage space and ultra-high resolution, and the position on the material object slice can be observed and the corresponding position can be amplified by utilizing the digital slice.
In the prior art, a high-resolution panoramic image of a physical slide is generally acquired by a digital slice scanner, and then the scanned digital slice is stored in a server. Medical personnel can access the server through the terminal device and browse the digital slices stored in the server, and remote diagnosis and remote teaching can also access the server through a network. For example, CN 105323306a discloses a digital pathological section storage and access system, which stores digital pathological sections in a cloud server, and a remote expert reads digital pathological section information through a web server. For another example, CN 102427467a discloses a remote browsing system for pathological digital slices, which calls a local virtual network camera through local instant messaging software to browse a pathological digital slice locally and send the pathological digital slice to remote instant messaging software, and then calls a remote virtual network camera to browse the pathological digital slice on a remote computing device. For another example, CN 109885234a discloses a slice reading method based on a mobile phone, which reads a control gesture through the mobile phone and correspondingly changes the size and position of a medical influence picture displayed on the mobile phone.
However, digital slices are large in data size, which may range from several hundred Megabytes (MB) to several hundred gigabytes (gigabytes, GB), and it may take a long time to transmit a complete digital slice image over a network to a remote computing device. Moreover, in order to help medical staff and experts to make accurate diagnosis, the high resolution of the digital slice image needs to be maintained as much as possible, and the resolution and the information are inevitably reduced and lost by means of a network camera or a webpage preview and the like. In addition, digital slice images provided to medical personnel and experts should be as equivalent as possible to the effect of viewing a slide of a real object under a microscope.
In summary, the problem to be solved is how to provide a display system and method for digital slicing, which can address the above-mentioned deficiencies of the prior art.
Disclosure of Invention
The embodiment of the application provides a display system and method for digital slicing, which are used for solving the problems in the prior art.
In a first aspect, the present application provides a display system for digital slicing. The display system includes: a first display device for performing slice image display in accordance with a first display configuration so as to simulate an observation result on an observation apparatus of a slice corresponding to an image displayed by the first display device; at least one second display device, wherein the at least one second display device is in one-to-one correspondence with at least one second display configuration, each of the at least one second display device is configured to perform slice image display according to the second display configuration of the second display device so that a display result of an image displayed by the second display device on the second display device approximates a display result of the image on the first display device in accordance with the first display configuration, and the second display configuration of the second display device is based on a difference between the second display device and the first display configuration.
In one possible implementation of the first aspect of the present application, the first display device is communicatively connected with the at least one second display device, and for each of the at least one second display device: the image displayed by the second display device is from the first display device.
In a possible implementation manner of the first aspect of the present application, the first display device and the at least one second display device perform communication and data interaction based on a websocket communication protocol, respectively, or the first display device and the at least one second display device perform communication and data interaction through a port mapping manner, respectively.
In one possible implementation of the first aspect of the present application, the first display configuration is based on a comparison between an observation result of at least one operator operating the observation apparatus to observe a first slice and a display result of a slice image display according to the first display configuration on the first display device with respect to a first image of the at least one operator corresponding to the first slice.
In one possible implementation of the first aspect of the application, the comparison result is based on at least physiological information and feedback of the at least one operator, the physiological information comprising at least an eye state.
In one possible implementation manner of the first aspect of the present application, the observation device is a microscope, and the observation result of the at least one operator operating the microscope to observe the first slice is based on a slice staining habit and a microscope configuration habit of the at least one operator.
In one possible implementation manner of the first aspect of the present application, the first display configuration of the first display device includes contrast, color temperature, and brightness of the first display device.
In one possible implementation manner of the first aspect of the present application, the second display configuration of each of the at least one second display device includes contrast, color temperature, and brightness of the second display device.
In a second aspect, the present application provides a display method for digital slices. The display method comprises the following steps: displaying, by a first display device, a slice image in accordance with a first display configuration to simulate an observation of a slice on an observation apparatus corresponding to an image displayed by the first display device; and performing slice image display according to respective second display configurations by at least one second display device so that a display result of an image displayed by the second display device on the second display device approaches a display result of the image displayed by the first display device according to the first display configuration, wherein the at least one second display device is in one-to-one correspondence with the at least one second display configuration, and the second display configuration of each second display device in the at least one second display device is based on a difference between the second display device and the first display configuration.
In one possible implementation manner of the second aspect of the present application, the observation apparatus is a microscope, the image displayed by each of the at least one second display device is from the first display device, the first display configuration is based on a comparison result between an observation result of at least one operator operating the microscope to observe a first slice and a display result of a slice image display according to the first display configuration on the first display device with respect to a first image corresponding to the first slice of the at least one operator, the observation result of the at least one operator operating the microscope to observe the first slice is based on a slice staining habit and a microscope configuration habit of the at least one operator, the first display configuration of the first display device includes a contrast, a color temperature, and a brightness of the first display device, and the second display configuration of each of the at least one second display device includes a contrast, a color temperature, and a brightness of the second display device.
In a third aspect, an embodiment of the present application further provides a computer device, where the computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the method according to any implementation manner of any one of the above aspects when executing the computer program.
In a fourth aspect, embodiments of the present application further provide a computer-readable storage medium storing computer instructions that, when executed on a computer device, cause the computer device to perform the method according to any one of the implementation manners of any one of the above aspects.
In a fifth aspect, the present application further provides a computer program product, which is characterized in that the computer program product includes instructions stored on a computer-readable storage medium, and when the instructions are run on a computer device, the instructions cause the computer device to execute the method according to any one of the implementation manners of any one of the above aspects.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a block diagram of a display system for digital slicing according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram illustrating an operation principle of a first display device according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a display method for digital slices according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a computing device according to an embodiment of the present application.
Detailed Description
Embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
The embodiment of the application provides a display system and method for digital slicing, which are used for solving the problems in the prior art. The method and the device provided by the embodiment of the application are based on the same inventive concept, and because the principles of solving the problems of the method and the device are similar, the embodiments, the implementation modes, the examples or the implementation modes of the method and the device can be mutually referred, and repeated parts are not described again.
It should be understood that, in the description of the present application, "at least one" means one or more than one, and "a plurality" means two or more than two. Additionally, the terms "first," "second," and the like, unless otherwise noted, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance, nor order.
Referring to fig. 1, fig. 1 is a block diagram of a display system for digital slicing according to an embodiment of the present disclosure. As shown in fig. 1, the display system includes a first display device 112 and at least one second display device 120. The at least one second display device 120 illustratively includes a mobile phone 122, a tablet computer 124, a desktop computer 126, a portable computer 128, a web server 130, and the like. It should be understood that the at least one second display device 120 may include any number and any type of display devices, and the example shown in fig. 1 is merely illustrative. The slice 101 is a physical slice such as a physical glass slice. The process of preparing the section 101 is generally to cut a tissue slice from a living body, for example, a suspicious lesion of a human body by an operation or the like, fix the tissue slice on a surface of a glass slide for staining, and the section 101 is also called a tissue section or a pathological section. Section 101 may be placed under viewing device 102 for viewing and provide a view 132. The observation device 102 may be a device for observing a slide of a material object, for example, a microscope such as an optical microscope or an electron microscope. Medical staff, experts, teachers, and the like operate the observation device 102 to observe the section 101, obtain structural features thereof, and perform pathological analysis, for example, pathological diagnosis of a tissue sheet cut off from a suspicious lesion on the section 101. Operator 140 represents any person, such as a medical professional, specialist, teacher, etc., that obtains observations 132 of section 101 through viewing device 102. The slice scanner 104 is used to perform an omni-directional full-information fast scan imaging of the entire slide on the slice 101 to produce a digitized virtual slice. The slide scanner 104 may be a digital slide scanner, a slide scanning system, a slide digital acquisition system, a pathology slide scanner, or any suitable device or system for converting a physical slide into a virtual digital slide, and is not particularly limited herein. The slice scanner 104 converts the slice 101 into a slice image corresponding to the slice 101, and the first display device 112 may display the slice image generated by the slice scanner 104. The slice scanner 104 typically stores the generated slice images in a server or a designated storage device (not shown) that the first display device 112 can access to acquire the slice images.
With continued reference to fig. 1, the first display device 112 is configured to display slice images according to a first display configuration to simulate viewing of a slice on the viewing apparatus 102 corresponding to the image displayed by the first display device 112. Taking the slice 101 as an example, the observation result 132 of the slice 101 on the observation device 102 means that the operator 140 obtains the observation result 132 of the slice 101 through the observation device 102, for example, the observation result of observing the lesion section on the slice 101 through a microscope. The slice 101 is passed through the slice scanner 104 to generate a slice image corresponding to the slice 101, which is displayed on the first display device 112 in accordance with the first display configuration. Thus, the first display device 112 is configured to perform slice image display according to a first display configuration so as to simulate an observation on the observation apparatus 102 of a slice corresponding to an image displayed by the first display device 112, e.g. the first display device 112 is configured to perform slice image display according to the first display configuration on a slice image corresponding to the slice 101 so as to simulate an observation 132 on the observation apparatus 102 of the slice 101 corresponding to the image displayed by the first display device 112. This means that when the operator 140 views the slice image on the first display device 112, the first display device 112 performs a slice image display according to the first display configuration, so that the first display device 112 simulates the observation of the slice on the observation apparatus 102 corresponding to the image displayed by said first display device 112. This means that the operator 140 obtains the observation 132 of the slice 101 through the observation apparatus 102, wherein the observation experience of the operator 140 and the rich information captured by his naked eye are preserved and represented in the process of displaying the slice image according to the first display configuration by the first display device 112. In other words, the experience and the information received by the naked eye of the operator 140, such as a doctor or an expert, observing the section, such as the section 101, under the observation device 102, such as a microscope, are influenced by the observation device 102 and the individual operating habits. For example, staining habits of the physician, microscope configuration habits, and the like may all affect the viewing experience of the physician. In order to make the experience of the same doctor viewing the slice image on the first display device 112 equivalent to the effect of observing the real object slice under the microscope, the first display device 112 may be used for displaying the slice image according to the first display configuration so as to simulate the observation result of the slice corresponding to the image displayed by the first display device 112 on the observation apparatus 102. That is, the display 134 according to the first display configuration as seen by the operator 140 on the first display device 112 simulates the observation 132 observed by the operator 140 on the observation apparatus 102 for the slice corresponding to the image displayed by the first display device 112.
With continued reference to fig. 1, the at least one second display device 120 is in one-to-one correspondence with the at least one second display configuration. Each of the at least one second display device 120 is configured to perform slice image display according to a second display configuration of the second display device such that a display result of an image displayed by the second display device on the second display device approximates a display result of the image on the first display device 112 that is displayed according to the first display configuration, and the second display configuration of the second display device is based on a difference between the second display device and the first display device 112 and the first display configuration. It was mentioned above that the display 134 according to the first display configuration seen by the operator 140 on the first display device 112 simulates the observation 132 observed by the operator 140 on the observation apparatus 102 for the slice corresponding to the image displayed by said first display device 112. The first display device 112 may be a local display device, such as a host, server, etc. located at the same site or local area network as the viewing apparatus 102, the slice scanner 104, etc. The first display device 112 may acquire the digital slice images directly or indirectly from the slice scanner 104 through a bus connection, a wired connection, or other connection suitable for high-speed data transmission, for example, the first display device 112 may be a doctor's work computer at a hospital, which is connected to a central server at the hospital and acquires the digital slice images in memory therefrom. However, the at least one second display device 120 may be a host, server, such as a computing device remotely logged in over the internet, not located at the same site or on the same local area network as the first display device 112. A number of examples of the at least one second display device 120 are illustrated in fig. 1. The cell phone 122 may be a personal cell phone of an operator 140 such as a doctor or a specialist, the tablet computer 124 may be a personal tablet computer of an operator 140 such as a doctor or a specialist, and the desktop computer 126, the portable computer 128, the web server 130, and the like may be a home desktop computer, a home notebook computer, a remote diagnosis interface, and the like of an operator 140 such as a doctor or a specialist. The at least one display device 120 represents various possible scenarios in which the operator 140 may view the digital slide images in a remote or non-locally connected manner. Each of the at least one second display device 120 is configured to display slice images according to the second display configuration of the second display device, which means that each of the second display devices, such as the mobile phone 122 and the tablet computer 124, has a corresponding second display configuration for specifying how to display slice images. Further, the slice image display according to the second display configuration of the second display device is such that the display result of the image displayed by the second display device on the second display device approximates the display result of the image on the first display device 112 for slice image display according to the first display configuration. For example, the cell phone 122 performs slice image display according to the second display configuration of the cell phone 122 such that the display effect of the image displayed on the cell phone 122 approximates the display result of the image displayed on the first display device 112 according to the first display configuration. In this way, the operator 140 may freely select a suitable second display device, such as the mobile phone 122 or the tablet computer 124, from the at least one second display device 120, and the display result 136 according to the second display configuration approaches the display result 134 according to the first display configuration. The display 134 according to the first display configuration in combination with the above simulates the observation 132 observed by the operator 140 on the observation apparatus 102 for the slice corresponding to the image displayed by said first display device 112, which means that the display 136 according to the second display configuration, which the operator 140 sees on the second display device selected from said at least one second display device 120, also equivalently simulates the observation 132 observed by the operator 140 on the observation apparatus 102 for the slice corresponding to the image displayed by said first display device 112.
It should be noted that the second display configuration of the second display device is based on the difference between the second display device and the first display device 112 and the first display configuration. The second display configuration of, for example, the cell phone 122, is based on the difference between the cell phone 122 and the first display device 112 and the first display configuration. This means that the respective second display configurations of all second display devices 120 can be normalized uniformly according to the first display device 112 and only the differences between each second display device and the first display device 112 need to be considered. Further, in one possible implementation, the first display device 112 is communicatively connected with the at least one second display device 120, and for each of the at least one second display device 120: the image displayed by the second display device is from the first display device 112. In this manner, an operator 140, such as a doctor, a specialist, or the like, may obtain the display 134 according to the first display configuration via the first display device 112, such as a hospital's work computer or a local computing device, and the display 134 simulates the observation obtained by the operator 140 on the observation device 102; the display result 136 according to the second display configuration may also be obtained by the second display device 120, and the approximation of the display result 136 to the display result 134 equivalently simulates the observation obtained by the operator 140 on the observation apparatus 102. That is, the operator 140 can freely select a conveniently available display device and obtain a consistent experience and information equivalent to the operator 140 observing the slide by eye whether the display device selected is local or remote, which is advantageous for remote diagnosis, remote teaching, expert consultation.
Further, given that digital slice images typically occupy a large amount of storage space, when the second display device 120 is remote and the first display device 112 is local, communication and data interaction is required over a network such as the internet. In order to efficiently and reliably enable the operator 140 to obtain the display result 136 according to the second display configuration through the second display device 120, in one possible embodiment, the first display device 112 and the at least one second display device 120 respectively perform communication and data interaction based on a websocket communication protocol, or the first display device 112 and the at least one second display device 120 respectively perform communication and data interaction through a port mapping manner. Here, the websocket communication protocol refers to a protocol for full duplex communication over a single connection, and can provide real-time two-way communication capability, and the port mapping manner means that a port of the first display device 112 is mapped to a port of the second display device 120, so that sharing of digital slice images is achieved in a screen projection-like manner. Through a websocket communication protocol or a port mapping mode, sharing of the shared digital slice images can be achieved, meanwhile, the complexity of data transmission is saved, and related communication and data transmission are simple and convenient. Therefore, the first display device 112 and the at least one second display device 120 respectively communicate and interact data based on the websocket communication protocol or the port mapping manner, so as to implement sharing of the slice image between the first display device 112 and the at least one second display device 120. The sharing of slice images thus achieved is subject to differences in the display effect of the same image caused by differences between the first display device 112 and the at least one second display device 120. In this regard, by the second display configuration of the second display device being based on the difference between the second display device and the first display device 112 and the first display configuration, the influence of the difference between the first display device 112 and the at least one second display device 120 on the display effect of the same image can be effectively overcome. Taking the mobile phone 122 as an example, the slice image can be shared between the mobile phone 122 and the first display device 112, such as a local work computer of a doctor, through a websocket communication protocol or a port mapping manner, which is beneficial for the doctor to browse the slice image on the mobile phone 122 quickly, but the display effect of the same slice image on the mobile phone 122 is affected by the difference between the mobile phone 122 and the first display device 112. Thus, by the second display configuration of the cell phone 122 being based on the difference between the cell phone 122 and the first display device 112 and the first display configuration, such difference can be effectively overcome. Therefore, high-speed and efficient sharing of slice images is also achieved while maintaining high resolution and retaining rich information.
In one possible embodiment, the first display configuration is based on a comparison between an observation that at least one operator (e.g., operator 140) operates the observation apparatus 102 to observe a first slice and a display of a first image corresponding to the first slice relative to the at least one operator on the first display device 112 in accordance with the first display configuration. Assuming that the first slice is the slice 101, the observation result 132 of the observation apparatus 102 operated by the at least one operator to observe the first slice, i.e. the slice 101, is used to compare with the display result (i.e. the display result 134 according to the first display configuration) of the first image corresponding to the first slice on the first display device 112 according to the first display configuration, which is relative to the at least one operator, so as to obtain the comparison result. Thus, the first display configuration is based on such comparison results, meaning that the first display configuration may be adjusted to minimize the gap between the observation and the display, for example, such that the display 134 according to the first display configuration is as close as possible to the observation 132. In some embodiments, the comparison result is based at least on physiological information and feedback of the at least one operator, the physiological information including at least an eye state. In practice, considering that the physiological information of the operator, such as the eye state, etc., also affects the experience and information obtained by the operator, such as a doctor or a specialist, through the first display device 112, and the second display device 120 is adjusted with reference to the first display device 112, the physiological information of the operator also affects the experience and information obtained by the operator through the second display device 120. To this end, the comparison result may also refer to physiological information of the operator, such as eye state, factors that may affect the visual observation, such as myopia, hyperopia, etc., of the eye, which may provide the operator with a better experience and also better approximate the experience of the operator looking through the viewing device 102 and with the naked eye. In addition, operator feedback, such as quantitative or qualitative comments, scores, and the like, may also be used to further improve the performance of the display system and the display method according to the embodiments of the present application. In some embodiments, the observation device 102 is a microscope, and the observation that the at least one operator operates the microscope to observe the first slice is based on the slice staining habits and microscope configuration habits of the at least one operator. As mentioned above, the process of making a section such as section 101 includes a staining step, and then the made section is placed under a microscope for observation. In order to better approximate the experience of the operator with the observation device 102 and with the naked eye, i.e. to better make the display 134 according to the first display configuration and the display 136 according to the second display configuration appear to the operator 140 as equivalent to the observation 132, the section staining habits and microscope configuration habits of the operator 140 may also be taken into account as reference factors and embodied in the observation 132, e.g. fine-tuning or the like. This is explained in detail below in connection with fig. 2.
Referring to fig. 2, fig. 2 is a schematic diagram illustrating an operation principle of a first display device according to an embodiment of the present application. As shown in FIG. 2, observations 204 are based on staining habits 210 and microscope configuration habits 220. The comparison result 206 is based on the observation 204 and the display result 202 according to the first display configuration. The comparison results 206 are imported into the machine learning model 200, the output of the machine learning model 200 is used to determine a first display configuration 208, and then the first display configuration 208 is used to determine the display results 202 according to the first display configuration. Alternatively, the machine learning model 200 may be replaced with a program, code, application, or any suitable software, algorithm, as long as the first display configuration 208 can be determined based on the comparison results 206. That is, the first display configuration is based on a comparison (e.g., comparison 206) between an observation (e.g., observation 204) of at least one operator operating the observation device to observe a first slice and a display (e.g., display 202) of a first image corresponding to the first slice with respect to the at least one operator on the first display device that displays slice images according to the first display configuration.
With continued reference to FIG. 2, in one possible implementation, the first display configuration of the first display device 112 includes contrast, color temperature, brightness of the first display device 112. In a possible embodiment, the second display configuration of each of the at least one second display device 120 comprises a contrast ratio, a color temperature, a brightness of the second display device. It should be understood that the first display configuration and/or the second display configuration may also include any other configuration factors that can affect the display of the slice images. It should be understood that, depending on the specific display device, the respective color gamuts of the first display device 112 and the second display device 120 may be consistent and may be different, and therefore, on the basis of adjusting the contrast, the color temperature and the brightness, the above technical effect may also be achieved by adjusting the image color of the slice image, such as the WSI, to overcome the influence of the color gamut difference of the display devices, for example, so that the display result 136 according to the second display configuration, which is seen by the operator 140 on the second display device selected from the at least one second display device 120, also equivalently simulates the observation result 132 of the slice observed by the operator 140 on the observation apparatus 102 and corresponding to the image displayed by the first display device 112.
Fig. 3 is a flowchart illustrating a display method for a digital slice according to an embodiment of the present application. As shown in fig. 3, the display method includes the following steps.
Step S310: by means of a first display device, a slice image display is performed according to a first display configuration so as to simulate an observation of a slice corresponding to an image displayed by the first display device on an observation apparatus.
Step S320: and performing, by at least one second display device, slice image display according to a respective second display configuration such that a display result of an image displayed by the second display device on the second display device approximates a display result of the slice image display according to the first display configuration on the first display device.
Wherein the at least one second display device is in one-to-one correspondence with at least one second display configuration, the second display configuration of each of the at least one second display device being based on a difference between the second display device and the first display configuration.
The display method for digital slices shown in fig. 3 allows a user to freely select a conveniently available display device and to obtain consistent experience and information equivalent to the user observing a physical slice with the naked eye regardless of whether the selected display device is local or remote, which is advantageous for remote diagnosis, remote teaching, expert consultation.
In a possible embodiment, the observation apparatus is a microscope, the image displayed by each of the at least one second display device is from the first display device, the first display configuration is based on a comparison between an observation result of at least one operator operating the microscope to observe a first slice and a display result of a slice image display on the first display device according to the first display configuration with respect to a first image of the at least one operator corresponding to the first slice, the observation result of the at least one operator operating the microscope to observe the first slice is based on a slice staining habit and a microscope configuration habit of the at least one operator, the first display configuration of the first display device includes a contrast, a color temperature, and a brightness of the first display device, and the second display configuration of each of the at least one second display device includes a contrast, a color temperature, and a brightness of the second display device.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a computing device provided in an embodiment of the present application, where the computing device 400 includes: one or more processors 410, a communication interface 420, and a memory 430. The processor 410, communication interface 420, and memory 430 are interconnected by a bus 440. Optionally, the computing device 400 may further include an input/output interface 450, and the input/output interface 450 is connected with an input/output device for receiving parameters set by a user, and the like. The computing device 400 can be used to implement some or all of the functionality of the device embodiments or system embodiments described above in this application; the processor 410 can also be used to implement some or all of the operational steps of the method embodiments described above in the embodiments of the present application. For example, specific implementations of the computing device 400 to perform various operations may refer to specific details in the above-described embodiments, such as the processor 410 being configured to perform some or all of the steps or some or all of the operations in the above-described method embodiments. For another example, in this embodiment of the application, the computing device 400 may be used to implement part or all of the functions of one or more components in the above-described apparatus embodiments, and the communication interface 420 may be specifically used to implement the communication functions and the like necessary for the functions of these apparatuses and components, and the processor 410 may be specifically used to implement the processing functions and the like necessary for the functions of these apparatuses and components.
It should be understood that the computing device 400 of fig. 4 may include one or more processors 410, and the processors 410 may cooperatively provide processing capabilities in a parallelized, serialized, deserialized, or any connection, or the processors 410 may form a processor sequence or an array of processors, or the processors 410 may be separated into a main processor and an auxiliary processor, or the processors 410 may have different architectures such as employing heterogeneous computing architectures. Further, the computing device 400 shown in FIG. 4, the associated structural and functional descriptions are exemplary and non-limiting. In some example embodiments, computing device 400 may include more or fewer components than shown in FIG. 4, or combine certain components, or split certain components, or have a different arrangement of components.
The processor 410 may be implemented in various specific forms, for example, the processor 410 may include one or more combinations of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a neural-Network Processing Unit (NPU), a Tensor Processing Unit (TPU), or a Data Processing Unit (DPU), and the embodiments of the present application are not limited in particular. Processor 410 may also be a single core processor or a multicore processor. The processor 410 may be a combination of a CPU and a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), a General Array Logic (GAL), or any combination thereof. The processor 410 may also be implemented as a single logic device with built-in processing logic, such as an FPGA or a Digital Signal Processor (DSP). The communication interface 420 may be a wired interface, such as an ethernet interface, a Local Interconnect Network (LIN), or the like, or a wireless interface, such as a cellular network interface or a wireless lan interface, for communicating with other modules or devices.
The memory 430 may be a non-volatile memory, such as a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash memory. The memory 430 may also be volatile memory, which may be Random Access Memory (RAM), which acts as external cache memory. By way of example, and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), SLDRAM (synchronous DRAM), and direct rambus RAM (DR RAM). The memory 430 may also be used to store program codes and data for the processor 410 to call the program codes stored in the memory 430 to perform some or all of the operational steps of the above-described method embodiments or to perform corresponding functions in the above-described apparatus embodiments. Moreover, computing device 400 may contain more or fewer components than shown in FIG. 4, or have a different arrangement of components.
The bus 440 may be a peripheral component interconnect express (PCIe) bus, an Extended Industry Standard Architecture (EISA) bus, a unified bus (UBs or UBs), a computer express link (CXL), a cache coherent interconnect protocol (CCIX) bus, or the like. The bus 440 may be divided into an address bus, a data bus, a control bus, and the like. The bus 440 may include a power bus, a control bus, a status signal bus, and the like, in addition to a data bus. However, for clarity, only one thick line is shown in FIG. 4, but this does not represent only one bus or one type of bus.
Embodiments of the present application further provide a system, where the system includes a plurality of computing devices, and the structure of each computing device may refer to the structure of the computing device described above. The functions or operations that can be implemented by the system may refer to specific implementation steps in the above method embodiments and/or specific functions described in the above apparatus embodiments, which are not described in detail herein. Embodiments of the present application also provide a computer-readable storage medium, in which computer instructions are stored, and when the computer instructions are executed on a computer device (such as one or more processors), the method steps in the above method embodiments may be implemented. The specific implementation of the processor of the computer-readable storage medium in executing the above method steps may refer to the specific operations described in the above method embodiments and/or the specific functions described in the above apparatus embodiments, which are not described herein again. Embodiments of the present application further provide a computer program product, which includes instructions stored on a computer-readable storage medium, and when the instructions are run on a computer device, the computer device is caused to execute the method steps in the above method embodiments.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. The present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Embodiments of the application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, the above-described embodiments may be implemented in whole or in part in the form of a computer program product. The present application may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium. The computer program product includes one or more computer instructions. When loaded or executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more collections of available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium, or a semiconductor medium. The semiconductor medium may be a solid state disk, or may be a random access memory, flash memory, read only memory, erasable programmable read only memory, electrically erasable programmable read only memory, registers, or any other form of suitable storage medium.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. Each flow and/or block in the flow charts and/or block diagrams, and combinations of flows and/or blocks in the flow charts and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks. These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments. It will be apparent to those skilled in the art that various changes and modifications can be made in the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. The steps in the method of the embodiment of the application can be sequentially adjusted, combined or deleted according to actual needs; the modules in the system of the embodiment of the application can be divided, combined or deleted according to actual needs. If these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, then the present application is intended to include these modifications and variations as well.
Claims (10)
1. A display system for digital slicing, the display system comprising:
a first display device for performing slice image display according to a first display configuration so as to simulate an observation result on an observation apparatus of a slice corresponding to an image displayed by the first display device;
at least one second display device, wherein the at least one second display device is in one-to-one correspondence with at least one second display configuration, each of the at least one second display device is configured to perform slice image display according to the second display configuration of the second display device so that a display result of an image displayed by the second display device on the second display device approximates a display result of the image on the first display device in accordance with the first display configuration, and the second display configuration of the second display device is based on a difference between the second display device and the first display configuration.
2. The display system of claim 1, wherein the first display device is communicatively connected with the at least one second display device and, for each of the at least one second display device: the image displayed by the second display device is from the first display device.
3. The display system according to claim 2, wherein the first display device and the at least one second display device respectively perform communication and data interaction based on a websocket communication protocol, or wherein the first display device and the at least one second display device respectively perform communication and data interaction in a port mapping manner.
4. The display system according to claim 1, wherein the first display configuration is based on a comparison between an observation that at least one operator operates the observation apparatus to observe a first slice and a display of a first image corresponding to the first slice with respect to the at least one operator displayed on the first display device in accordance with the first display configuration.
5. The display system of claim 4, wherein the comparison result is based on at least physiological information and feedback of the at least one operator, the physiological information including at least an eye state.
6. The display system according to claim 4, wherein the observation device is a microscope, and the observation result of the at least one operator operating the microscope to observe the first slice is based on a slice staining habit and a microscope configuration habit of the at least one operator.
7. The display system of claim 6, wherein the first display configuration of the first display device comprises contrast, color temperature, brightness of the first display device.
8. The display system of claim 7, wherein the second display configuration of each of the at least one second display devices comprises contrast, color temperature, and brightness of the second display device.
9. A display method for digital slices, the display method comprising:
displaying, by a first display device, a slice image in accordance with a first display configuration to simulate an observation of a slice on an observation apparatus corresponding to an image displayed by the first display device;
and performing slice image display according to respective second display configurations by at least one second display device so that a display result of an image displayed by the second display device on the second display device approaches a display result of the image displayed by the first display device according to the first display configuration, wherein the at least one second display device is in one-to-one correspondence with the at least one second display configuration, and the second display configuration of each second display device in the at least one second display device is based on a difference between the second display device and the first display configuration.
10. The display method according to claim 9, wherein the observation apparatus is a microscope, the image displayed by each of the at least one second display device is from the first display device, the first display configuration is based on a comparison between an observation result of at least one operator operating the microscope to observe a first slice and a display result of a slice image display on the first display device according to the first display configuration with respect to a first image corresponding to the first slice by the at least one operator, the observation result of the at least one operator operating the microscope to observe the first slice is based on a slice staining habit and a microscope configuration habit of the at least one operator, the first display configuration of the first display device includes a contrast, a color temperature, and a brightness of the first display device, and the second display configuration of each of the at least one second display device includes a contrast, a color temperature, and a brightness of the second display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211353915.1A CN115407959A (en) | 2022-11-01 | 2022-11-01 | Display system and method for digital slicing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211353915.1A CN115407959A (en) | 2022-11-01 | 2022-11-01 | Display system and method for digital slicing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115407959A true CN115407959A (en) | 2022-11-29 |
Family
ID=84167859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211353915.1A Pending CN115407959A (en) | 2022-11-01 | 2022-11-01 | Display system and method for digital slicing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115407959A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160183922A1 (en) * | 2014-11-07 | 2016-06-30 | Oreon Technologies Inc. | Apparatus and method for planar image synchronization |
| CN109147912A (en) * | 2018-08-30 | 2019-01-04 | 宁波江丰生物信息技术有限公司 | A kind of digital slices scan method and device |
| CN111175958A (en) * | 2019-12-31 | 2020-05-19 | 杭州迪英加科技有限公司 | Remote consultation method and system for pathological section under microscope |
-
2022
- 2022-11-01 CN CN202211353915.1A patent/CN115407959A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160183922A1 (en) * | 2014-11-07 | 2016-06-30 | Oreon Technologies Inc. | Apparatus and method for planar image synchronization |
| CN109147912A (en) * | 2018-08-30 | 2019-01-04 | 宁波江丰生物信息技术有限公司 | A kind of digital slices scan method and device |
| CN111175958A (en) * | 2019-12-31 | 2020-05-19 | 杭州迪英加科技有限公司 | Remote consultation method and system for pathological section under microscope |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10769788B2 (en) | Few-shot learning based image recognition of whole slide image at tissue level | |
| US11604949B2 (en) | Image processing method and apparatus, computer-readable storage medium, and computer device | |
| US12118739B2 (en) | Medical image processing method, apparatus, and device, medium, and endoscope | |
| JP5734525B2 (en) | Medical support system and method | |
| CN109712217B (en) | Medical image visualization method and system | |
| JP7564228B2 (en) | Medical image processing method and system, and data processing method | |
| CN112712906B (en) | Video image processing method, device, electronic equipment and storage medium | |
| US10304564B1 (en) | Methods and systems for displaying an image | |
| US20200320701A1 (en) | Image processing method and apparatus and neural network model training method | |
| US11483372B2 (en) | Artificial intelligence based imaging systems and methods for interacting with individuals via a web environment | |
| JP2016031747A (en) | Information processing apparatus and information processing method | |
| JP2021526270A (en) | Medical image four-dimensional visualization method and equipment | |
| CN111985197A (en) | Template generation method based on medical information | |
| CN106202927A (en) | The rendering intent of medical image and system | |
| US20210257071A1 (en) | Health Monitoring Method and System, Print Terminal, and Computer-Readable Storage Medium | |
| US10820962B2 (en) | Surgical optical system with heads up display | |
| CN115407959A (en) | Display system and method for digital slicing | |
| CN112820385A (en) | Medical image browsing method, client and system | |
| CN116869555A (en) | Scanning protocol adjusting method, device and storage medium | |
| CN111798967A (en) | Wisdom ultrasonic testing system | |
| CN113961845A (en) | Method, system and server for rapidly displaying DICOM image | |
| CN112863700A (en) | Medical image cooperation method, device, equipment and computer storage medium | |
| CN114388145B (en) | Online inquiry method and device | |
| CN111259696B (en) | Method and device for displaying image | |
| CN111461991B (en) | Image drawing method, image drawing device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20221129 |
|
| RJ01 | Rejection of invention patent application after publication |