CN111916198A - Display method and user interface - Google Patents

Display method and user interface Download PDF

Info

Publication number
CN111916198A
CN111916198A CN202010635864.6A CN202010635864A CN111916198A CN 111916198 A CN111916198 A CN 111916198A CN 202010635864 A CN202010635864 A CN 202010635864A CN 111916198 A CN111916198 A CN 111916198A
Authority
CN
China
Prior art keywords
area
media object
target slice
display
display area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010635864.6A
Other languages
Chinese (zh)
Inventor
李文勇
陈巍
王鹏
蹇秀红
殷亚娟
陶军之
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Disset Medical Technology Co ltd
Original Assignee
Jiangsu Disset Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Disset Medical Technology Co ltd filed Critical Jiangsu Disset Medical Technology Co ltd
Priority to CN202010635864.6A priority Critical patent/CN111916198A/en
Publication of CN111916198A publication Critical patent/CN111916198A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The present invention relates to the field of improvement of slice imaging user interfaces, and more particularly to a display method and a user interface. A method of displaying a graphical user interface on a display includes displaying different image analysis or data analysis results in response to a user input and generating an initial screen layout of one or more media objects corresponding to the different image analysis or data analysis.

Description

Display method and user interface
Technical Field
The present invention relates to the field of improvement of slice imaging user interfaces, and more particularly to a display method and a user interface.
Background
Pathological examination is a pathomorphological method for examining pathological changes in organs, tissues or cells of the body. In order to study the disease process of organs, tissues or cells, some kind of pathological morphological examination method can be used to examine the pathological changes of them, study the cause, pathogenesis and the process of pathological changes, and finally make pathological diagnosis. The pathological morphological examination method is that the pathological change of the general specimen is observed, then the pathological tissue with certain size is cut out, the pathological section is made by the pathological histological method, and the pathological change is further examined by a microscope.
The digital section system can rapidly scan the whole glass slide in a full-information and all-round way, so that the traditional materialized glass slide becomes a new generation of digital pathological section, and the digital section system is an epoch-making revolution for realizing pathological diagnosis technology. The system can separate a pathologist from a microscope, solve pathological diagnosis through a network at any time and any place, realize global online synchronous remote consultation or offline remote consultation, and has great significance for time and space alternation and transmission advantages of diagnosis value equal to that of microscope observation due to the fact that full-section information is provided. And multilayer three-dimensional reconstruction of pathological sections and management digitization of the pathological sections are also realized. The system can be widely used for pathological clinical diagnosis, pathological teaching, histological cell imaging, fluorescence analysis and immunohistochemical digital imaging. The glass slice is scanned into a digital slice, so that the storage and the circulation are convenient; just like scanning the common developed photo into a digital photo, the photo can be read and examined on a computer without singly observing the photo by using a microscope.
The existing digital slicing system can clearly and visually check the complete area of the slices, so that the traditional mode of observing the slices point by point through a high-power microscope can be replaced, the checking speed of the human tissue slices is effectively improved, and the efficiency and the accuracy of diagnosis of doctors are improved. However, the user interface of the existing pathological section scanner cannot monitor the scanning process of the section in real time.
Disclosure of Invention
In order to solve the above technical problems, a first aspect of the present invention provides a method of displaying a graphical user interface on a display, including displaying different image analysis or data analysis results in response to an input of a user, and generating an initial screen layout of one or more media objects corresponding to the different image analysis or data analysis.
As a preferred solution, the initial screen layout comprises a first display area configured to display a first media object of a target slice; and a second display area configured for executing, monitoring the target slice and the machine; the first media object is a media object captured when cells on a target slice are scanned, and is related to the area, the position and the thickness of the cells on the target slice.
As a preferred solution, the initial screen layout further comprises a third display area configured to display a reduced version of the first media object.
As a preferred technical solution, the initial screen layout further includes a fourth display area configured to display the second media object of the target slice; and the second media object is a media object captured when the label information on the target slice is scanned.
Preferably, the first media object is a photographed image displayed in real time.
Preferably, the photographic image is a panoramic image.
As a preferred technical solution, the first media object includes a scanning-completed area and an uncompleted scanning area.
As a preferred technical solution, the scanning completion area and the scanning uncompleted area are distinguished by using different color renderings.
As a preferred technical solution, the second display area includes a button control area for controlling buttons including start, pause, and end; a parameter adjustment area for controlling execution of program instructions; and the state display area is used for displaying the running state information of the target slice and the machine.
A second aspect of the present invention provides a computer system having the graphical user interface described above, having computer-executable instructions for executing a process for displaying one or more media objects on a computer; wherein the one or more media objects are associated with tag information on the target slice or cell area, location, thickness on the target slice; the computer system comprises a display, a processor, and a user input device; the processor is used for processing instructions, executing operation, controlling time and processing scanning information of the target slice; the user input device is connected to the processor and displays an initial picture layout on a display; the initial screen layout is responsive to input from the user input device and the corresponding one or more media objects are analyzed using different image or data obtained from a processor.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides a graphical user interface for slice imaging, which displays scanning information in the process of the operation stage of a scanner through a human-computer interaction interface, can realize the operation of starting scanning, pausing or stopping scanning through adjusting a button on the interface, displays real-time scanning data in the process on a display after being operated by a processor, and can intuitively acquire useful information from the interface by a user so as to facilitate the diagnosis of diseases.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings used in the embodiments will be briefly described below, the drawings described below are only some embodiments of the present invention, and it is obvious to those skilled in the art that other drawings can be obtained based on the drawings without creative efforts.
FIG. 1 is a simplified overview of a pathological section scanner of the present invention;
FIG. 2 is a graphical user interface view of an acquired slice image;
FIG. 3 is a first display area screen in a user interface;
FIG. 4 is a second display area screen in the user interface;
FIG. 5 is a view of a parameter loading area in a second display area of the user interface;
the numbering in the figure is as follows:
101. a display; 102. a processor; 103. a user input device; 104. a scanner; 105. glass slide; 201. a first display area; 202. a third display area; 203. a fourth display area; 204. a fifth display area; 205. a second display area; 211. a first media object A; 212. a first media object a; 221. a button control area; 222. a parameter adjustment area; 223. a status display area.
Detailed Description
The technical features of the technical solutions provided by the present invention are further clearly and completely described below with reference to the specific embodiments.
The pathological section scanner is an automatic digital section scanning, managing, viewing and analyzing system, which is used for displaying and detecting clinically interested tissues and cells, counting and classifying according to color, intensity, size, pattern and shape, and providing an auxiliary means for in vitro diagnosis for pathologists.
In some embodiments, a computer system for a graphical user interface having computer-executable instructions for executing a process for displaying one or more media objects on a computer; wherein the one or more media objects are associated with tag information on the target slice or cell area, location, thickness on the target slice; the label information on the target slice described herein refers to identity information including but not limited to a barcode or a two-dimensional code that can be recognized by an algorithm, and such label information may be fixed on the target slice in any manner, such as by printing, pasting, printing, and the like.
In some embodiments, at least one media object is associated with the cell area, position, and thickness of the target slice, and before the media object is obtained, the processor calculates information about the cell area, position, and thickness of the target slice by detection, automatically selects or increases the number of scanning layers according to the information to scan and shoot the images at different positions with different depths of field, and performs horizontal stitching and vertical fusion on the images to obtain the media object for evaluation, and displays one or more captured media objects on the display after the images are qualified.
As shown in FIG. 1, a computer system for a graphical user interface includes a display 101, a processor 102, a user input device 103; the processor 102 is used for processing instructions, executing operations, controlling time, processing scanning information of the slice 105; the user input device 103 is connected to the processor 102, and generates an initial screen layout on the display 101; the initial screen layout is responsive to input from the user input device 103 and the corresponding one or more media objects are analyzed using different image or data analysis obtained from the processor 102.
The display 101 provides a graphical user interface for the scanner 104 or operator to interact with the system and the data generated. The user may interact with the interface and provide input through a variety of means, including but not limited to: mouse clicks, touch screen components, scroll wheels, buttons, knobs, etc.
In some implementations, a method of displaying a graphical user interface on a display includes displaying different image analysis or data analysis results in response to a user input and generating an initial screen layout of one or more media objects corresponding to the different image analysis or data analysis.
In some embodiments, as shown in fig. 2, a graphical user interface for slice imaging includes a first display area 201 configured to display a first media object of a target slice; and a second display area 205 configured for executing, monitoring the target slice and the machine; the first media object is a media object captured when cells on a target slice are scanned, and is related to the area, the position and the thickness of the cells on the target slice.
In the first display area 201, the user can observe the area of the slide that has been photographed and the area of the slide that remains to be photographed; for example, for a typical liquid-based cytopathological slide, the area is a circular area of 15 × 15mm or 10 × 10 mm; the lens of the scanner is generally a lens of 20 times or 40 times, the shot cells belong to micron level, therefore, the shooting distance between the camera and the slide is very close, the camera is almost stuck on the surface of the slide for shooting, and about 500 lenses are needed to shoot relative to the area of 15 × 15mm or 10 × 10mm to cover the whole area; in this area, therefore, the area of the area photographed by the camera at one time can be observed by the user.
In a preferred embodiment, the first media object is a photographic image displayed in real time.
In a preferred embodiment, the photographic image is a panoramic image.
In a preferred embodiment, the first media object includes a scan complete area and an incomplete scan area.
In a preferred embodiment, the scan complete area and the scan incomplete area are distinguished using different color renderings.
In a preferred embodiment, the first display area 201 includes two photographic images that can be selectively switched; that is, the first media object is selected from any one of a media object in a real-time cellular state, a media object in a real-time scanning region; as shown in fig. 3, the first media object is a media object in a real-time cellular state, and is denoted as a first media object a 211; as shown in fig. 3, the first media object is a media object in a real-time scanning area, and is denoted as a first media object a 212; the two media objects can be switched arbitrarily. When the user selects to switch to 203, for example, the shaded portion represents the area of the slice that has been photographed by the camera, and the unshaded portion represents the remaining area of the slice that still needs to be photographed.
In a preferred embodiment, a third display area 202 is further included, configured to display a scaled down version of the first media object; the third display area 202 shows the actual scanning, and the reduced cell image can be seen through the third display area 202, but if a high-resolution image is seen, the image reading system software is required to browse, or the image reading system is switched to the first display area 201 to view the photographed image 211 in real time. The third display area 202 is mainly used for the user to see the approximate distribution of the cells and the approximate state of the scanning area.
In a preferred embodiment, a fourth display area 203 is further included, configured to display the second media object of the target slice; and the second media object is a media object captured when the label information on the target slice is scanned.
In the fourth display area 203, the image and the calculated scan area, and the identification area of the barcode data are displayed. For example, in the view shown in fig. 2, the position of the circle is the area that needs to be scanned by the scanner, and the rightmost side displays a bar code or two-dimensional code, which can be automatically recognized by the machine through an algorithm.
In a preferred embodiment, the system further comprises a fifth display area 204 configured to display parameter information of the operation of the machine; more specific information is displayed as the slide is scanned. For example, in the view shown in fig. 2, information such as a sample number, a scan completion date and time, a position in a folder, and the like can be embodied.
In a preferred embodiment, the second display area 205 includes a button control area 221 for control of buttons including start, pause, and end; a parameter adjustment area 222 for controlling execution of program instructions; and a status display area 223 for displaying the target slice and the running status information of the machine.
In a preferred embodiment, the button control area 221: start, pause, end and other button control areas and partial parameter setting areas of the system. The button control area 221 includes (1) a button function area; (2) a parameter loading area: selecting parameters to be scanned, and after the parameters are clicked and loaded, scanning can be performed; the loaded parameters comprise parameter adjustment of the number of scanning layers, the number of fusion layers and the thickness interval of each layer.
In a preferred embodiment, the parameter tuning region 222 includes (1) a transmitted client that displays client connection status; (2) and (3) transmitting an instruction: whether to transmit an instruction to the graph cutting machine; (3) transferring the file: whether to transmit the picture to the picture cutting machine; (4) WB: whether white balance is selected; (5) fcous selection: enabling focusing; (6) starting a CTF function, and setting a CTF threshold value; (7) send Test Msg: and sending the test message.
In a preferred embodiment, the status display area 223 includes (1) the total cardholder number: representing the total clip number of the disposable material loading; (2) scanning the number of the slices: the number of slices that have been scanned; (3) scanning platform vacuum state: the vacuum state of the wafer placed on the platform is reflected; (4) client connection state: reflecting the connection state with the Client; (5) motor state (6) communication state reset: resetting the internal communication state of the machine; (7) rereading the position information: reading all current position information of the whole machine; (8) starting a priority card holder: the checking-selecting priority card holder scanning function is realized; (9) starting gate detection: checking to show that the safety door protection function is opened; (10) mapping control.
The user interface of the invention contains a large amount of abundant data and image analysis results, for example, a doctor needs to see a cell region, so that the system can calculate the shooting position and shooting times needed for scanning the whole sample area through an automatic algorithm, and the shooting results are displayed on each window for the doctor to view and reference.
Finally, it should be understood that the above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A method of displaying a graphical user interface on a display, comprising displaying different image analysis or data analysis results in response to a user input, and generating an initial screen layout of one or more media objects corresponding to the different image analysis or data analysis.
2. The method of claim 1, wherein the initial screen layout comprises a first display area configured for displaying a first media object of a target slice; and a second display area configured for executing, monitoring the target slice and the machine; the first media object is a media object captured when cells on a target slice are scanned, and is related to the area, the position and the thickness of the cells on the target slice.
3. The method of claim 2, wherein the initial screen layout further comprises a third display area configured to display a scaled-down version of the first media object.
4. The method of claim 3, wherein the initial screen layout further comprises a fourth display area configured to display a second media object of a target slice; and the second media object is a media object captured when the label information on the target slice is scanned.
5. The method of any of claims 4, wherein the first media object is a photographic image displayed in real-time.
6. The method of claim 5, wherein the photographic image is a panoramic image.
7. The method of any of claims 2-6, wherein the first media object includes a scan complete area and an incomplete scan area.
8. The method of claim 7, wherein the scan complete area and the scan incomplete area are distinguished using different color renderings.
9. The method of claim 8, wherein the second display area includes a button control area for control of buttons including start, pause, terminate; a parameter adjustment area for controlling execution of program instructions; and the state display area is used for displaying the running state information of the target slice and the machine.
10. A computer system having computer-executable instructions for executing a process for displaying one or more media objects on a computer; the one or more media objects are related to tag information on the target slice or cell area, location, thickness on the target slice; the computer system comprises a display, a processor, and a user input device; the processor is used for processing instructions, executing operation, controlling time and processing scanning information of the target slice; the user input device is connected to the processor and displays an initial picture layout on a display; the initial screen layout is responsive to input from the user input device and the corresponding one or more media objects are analyzed using different image or data obtained from a processor.
CN202010635864.6A 2020-07-03 2020-07-03 Display method and user interface Pending CN111916198A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010635864.6A CN111916198A (en) 2020-07-03 2020-07-03 Display method and user interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010635864.6A CN111916198A (en) 2020-07-03 2020-07-03 Display method and user interface

Publications (1)

Publication Number Publication Date
CN111916198A true CN111916198A (en) 2020-11-10

Family

ID=73227479

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010635864.6A Pending CN111916198A (en) 2020-07-03 2020-07-03 Display method and user interface

Country Status (1)

Country Link
CN (1) CN111916198A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003096228A1 (en) * 2002-05-10 2003-11-20 Tripath Imaging, Inc. Video microscopy system and multi-view virtual slide viewer capable of simultaneously acquiring and displaying various digital views of an area of interest located on a microscopic slide
EP3440992A1 (en) * 2017-08-11 2019-02-13 Ningbo Konfoong Bioinformation Tech Co., Ltd. Digital pathological section scanning system
CN111337495A (en) * 2020-04-09 2020-06-26 江苏迪赛特医疗科技有限公司 Pathological section image whole-course quality control device and pathological section analysis device
CN111415736A (en) * 2020-04-09 2020-07-14 江苏迪赛特医疗科技有限公司 Graphic user interface for slice imaging device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003096228A1 (en) * 2002-05-10 2003-11-20 Tripath Imaging, Inc. Video microscopy system and multi-view virtual slide viewer capable of simultaneously acquiring and displaying various digital views of an area of interest located on a microscopic slide
EP3440992A1 (en) * 2017-08-11 2019-02-13 Ningbo Konfoong Bioinformation Tech Co., Ltd. Digital pathological section scanning system
CN111337495A (en) * 2020-04-09 2020-06-26 江苏迪赛特医疗科技有限公司 Pathological section image whole-course quality control device and pathological section analysis device
CN111415736A (en) * 2020-04-09 2020-07-14 江苏迪赛特医疗科技有限公司 Graphic user interface for slice imaging device

Similar Documents

Publication Publication Date Title
EP3776458B1 (en) Augmented reality microscope for pathology with overlay of quantitative biomarker data
CN111474701B (en) Pathological microscopic image real-time acquisition and analysis system, method, device and medium
US9110305B2 (en) Microscope cell staining observation system, method, and computer program product
US8995733B2 (en) Microdissection method and information processing system
US11636627B2 (en) System for histological examination of tissue specimens
US7831075B2 (en) Imaging system
EP2544141A1 (en) Diagnostic information distribution device and pathology diagnosis system
US7873193B2 (en) Serial section analysis for computer-controlled microscopic imaging
US20090212242A1 (en) Microscope System and VS Image Production and Program Thereof
KR20150094618A (en) Systems and methods for split screen display of a biological specimen and for capturing records thereof
KR20150095646A (en) Selection and display of biomarker expressions
CN101592653A (en) Fully automatic operation instrument for routine inspection of excrement
CN111337495A (en) Pathological section image whole-course quality control device and pathological section analysis device
CN103558404A (en) Automatic cell DNA (deoxyribonucleic acid) detecting and rechecking method based on digital slides
JP4864709B2 (en) A system for determining the staining quality of slides using a scatter plot distribution
JP2021515912A (en) Digital pathology scanning interface and workflow
KR20210084602A (en) Digital Imaging Systems and Methods
EP4231954A1 (en) Systems and methods for capturing, displaying, and manipulating medical images and videos
CN111916198A (en) Display method and user interface
CN111415736A (en) Graphic user interface for slice imaging device
US20230266819A1 (en) Annotation data collection using gaze-based tracking
KR20190088663A (en) Integrated pathology image information management system managing entire process of pathology examination by using image information
CN111134735A (en) Lung cell pathology rapid on-site evaluation system and method and computer readable storage medium
CN115019977A (en) Pathological full-process quality control system and method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination