CA2976443A1 - System and method to objectively measure quality assurance in anatomic pathology - Google Patents

Abstract

Techniques are described that facilitate generation of a practice proficiency score related to the quality of a pathology department processes (e.g., quality of/accuracy of pathologist diagnoses, etc.). In one or more implementations, a method may comprise generating an assessment metric based upon a comparison of the first image attribute with a second image attribute. The first image attribute comprises an attribute associated with a digital image representing a specimen. The method also includes receiving a diagnostic confidence metric corresponding to the specimen. The method also includes receiving a diagnostic accuracy metric corresponding to the specimen. The method also includes receiving a turn around time metric corresponding to the specimen. The method also includes receiving a clerical accuracy metric corresponding to the specimen. The method also includes causing a processor to generate a score representing a proficiency corresponding to the specimen. The score is based upon the assessment metric, the diagnostic confidence metric, the diagnostic accuracy metric, the torn around- time metric, and the clerical accuracy metric.

Description

SYSTEM AND METHOD TO OBJEC.TIVELY MEASURE QUALITY
ASSURANCE IN ANATOMIC PATHOLOGY
BACKGROUND
[00011 Anatomical (Or .artalOmic) pathology is a medical sPecialty Concerned with the diagnosis of disease based upon macroscopic, microscopic, biochemical, iirtmunotogic..
and molecular.examiitation of organs and tissues.
SUMMARY
j0002[ Techniques are described that facilitate generation of a practice proficiency score related to the quality of a pathology department processes (e.gõ quality offaccuracy of pathologist diagnoses, etc,).. In one or more implementations, a method may comprise determining a first imago attribute of a digital image of a-specimen based upon at least one image characteristic of the digital image, the. digital image captured by an image capture device and generating an assessment metric based upon a comparison of the first image attribute with a second image attribute provided by a elient 'device, The method also includes receiving a diagnOstic confidence metric corresponding to the specimen. The diagnostic confidence metric comprises an indication Of whether a Second review of the specimen occurred. The method also includes receiving a diagnostic accuracy metric corresponding to the specimen. The diagnostic accuracy metric comprises an accuracy indication of a diagnosis or the anatomic pathology specimen. The method also includes receiving a turn around time metric corresponding to the specimen. The turn around time metric comprises =a time ranging from a case accession time toa case sign out time. The method also includes receiving a clerical accuracy metric corresponding to the specimen.
The clerical accuracy metric comprises .a clerical accuracy parameter .pertaining to the.
specimen. The method also includes causing a .processor to generate a score representing.
a proficiency corresponding to the specimen. The score is based upon the assessment metric, the diagnostic confidence metric, the diagnostic accuracy metric, the turn around.
time metric, and the clerical accuracy metric, 100031 This Summary is provided to introduce a selection of concepts in a simplified form that arc further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter, BRIEF DESCRIPTION OF THE DRAWINGS
f0(I04l The detailed description is described with reference to the accompanying figures.
In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items.
1004)5l FIG.. I A is an illustration of an environment M an example implementation that includes a server operable to generate a practice proficiency score in accordance with an example implementation oldie present disclosure.
100061 FIG. 113 is an example graphical representation of an alert displayed within an unobscured portion of a display of a client device in accordance with an example implementation of the present disclosure.
IOW) FIG. IC is an example graphical representation of an alert displayed within a display of a client device in accordance with an example implementation or the present disclosure, where the alert includes a URL link for accessing one or more reports graphically representing a practice proficiency score.
[NOM FIG, 2 is an example graphical representation of the practice proficiency score in accordancc with an example implementation of the present disclosure.
100091 FIG. 3 is another example graphical representation of the practice proficiency sc=ore in accordance with an example implementation of the present disclosure.
10010l FIG. 4 is another example graphical representation or the practice proficiency score in accordance with an example implementation of the present disclosure.
[OM FIG, 5 is another example graphical representation of the practice proficiency score in accordance with an example implementation of the present disclosure.
100121 HO. 6 is a flow diagram illustrating an example method for generating n practice proficiency score based upon multiple metrics corresponding to a specimen in accordance with an example implementation of the present disclosure,

2 DETAILED DESCRITTION
10013) The term quality assurance refers to the documented evidence that a process or system performs according to predetermined specifications and quality attributes, The practice of anatomic pathology involves performing a subjective interpretation of microscopic tissue characteristics and objective data, and to select specific language to convey a diagnosis. The objective data, contained in the characteristics of the cells, organization of tissues, and relationship to the organ on the whole, are preserved for the Initial examination on histologic glass slides or in a digitized image forrnat. Many factors contribute to the lack of objectivity and dia,gnostic inaccuracy, including the training and skill of the pathologist.. quality of the slide, level of pathologist confidence and methods to access the quality of pathology services, [0014/ One of the possible contributing factors is the use of an intra-departmemal consultation or second opinion method to assess the quality of a pathology service. The College of American Pathologists (CAP) has established guidelines for both intra-departmental and extra-departmental quality consultations These guidelines appear to have failed to encourage quality assurance activities that result in optimal diagnostic accuracy, consistency in terminology, and timely care for patients, Over the past two deeadesõ several studies have published the rates of diagnostic discrepancy. A
discrepancy is defined as: when one pathologist renders a diagnosis and another pathologist looks at the same material and renders a different opinion/diagnosis.
10015) Another likely contributing factor to the subjectivity is the absence of an objective measure to assess the quality of the pre -analytic. analytic and post -analytic processes of the pathology service.. Existing standardized scoring quality assurance pmgrams are:
External Quality Assurance (eQA) and Proficiency Testing (PT). These existing quality assurance programs are limited in their scope and suffer from lack of granularity and completeness of quality review, 00161 Thus, quality assurance measurements need to be applied across the pre-analytical, analytical and post-analytical diagnostic process to ensure the patient receives the best diagnosis possible. Accordingly< a system is disclosed that generates a practice proficiency score related to the quality of a pathology department process and associated diagnosis

3 related anifacts: The system receives information identifying a case submission; receives information, digital images. and data associated with the case from the laboratory/pathology information system; receives whole-slide imaging files of digital M icroscopy -technologies: receives information related to the quantitative and qualitative.
analysis performed by an image analysis application; receives quality assurance review of the final diagnosis for accuracy as provided by external reviewers; and causes calculation of an objective measure of pathology service. proficiency. The objective measure enables comparable comparisons in generating benchmarkine tools that help identify professional strengths and areas of improvement When compared to a matching peer group and practice, (OM Certain.. embodiments as disclosed herein provide for systems and methods to objectively measure quality assurance in anatomic pathology. However, although Various implementations of the present disclosure. are described herein and presented by way of example specific to anatomic patholoay,, the disclosure has other embodiments and applicability to other disciplines as to not limit the scope or breadth of the current disclosure. In one embodiment, a system and method of quality assurance that generates a unique Practice Proficiency Score (PPS) that is used to benchmark quality performance in pathology, and for medical practice continuous improvement. The program comprises five.
(5) metrics that may have a role in reducing diagnostic error.
100181 FIG, IA illustrates an environment 100 in an exam* implementation that is operable to facilitate generation of an objective measure of pathology service proficiency corresponding to a case in accordance with,the present disclosure, The case May comprise one or more metrics relating to a.specirnen. For example, the specimen may Comprise an anatomic pathology specimen and/or a clinical laboratory specimen. The anatomic pathology specimen may include, but is .not limited to. specimens used to determine the presence of cancer or dermal disorders. The illustrated environment 100 includes a server 102 and one. or more client .devices 104 that communicates with the server 102 via one or more networks 106.
100191 The server 102 may be configured. in a variety of ways. For example, the server 102 may be configured as one or more server computers that are capable of commuiticating Over a wired or wireless network. 106. The client device 10,4 may also be configured in a variety of ways. For example, the client device 104 may be configured as a computing

4 device independent of the server 102. For instance, the client device 104 may comprise a desktop computing device, a server computing device, a laptop computing device, a tablet, a mobile electronic device, and so forth, that is capable of communicating over a wireless network. Additionally, although one client device 104 is illustrated, it is understood that the server 102 may provide the functionality described herein to allittiple mobile electronic devices 104. The client device(s) 104 can be utilized to provide the system 100 one or more <lithe quality metrics described below, 100201 The network 106 may assume a wide variety of configurations. For example, the network 106 may comprise any of a plurality of communications standards, protocols and technologies_ includmg. but not limited to: a 30 communications network, a 40 communications network. a Global System for Mobile Communications (GSM) environment, an Enhanced Data GSM Environment (EDGE) network. a high-speed downlink packet access (1-1SDPA) network, a wideband code division multiple access (W-CDMA) network, a code division multiple access (CDMA) network, a time division multiple access (TDMA) network, Bluetooth, Wireless Fidelity (WI-Fi) (e.g., IEEE
802,1 la, IEEE 802,1 lb, IEEE 802,11 and/or IEEE 802,114 voice over Internet Protocol (VolP), \Vi-MAX. a protocol for email (e.g.. Internet message access protocol (1MAP) andlor post office protocol (POP)) environment, an instant messaging (e,a., extensible messaging and presence protocol (XMPP) environment, Session Initiation Protoccd for Instant Messaging and Presence Leveraging Extensions (SIMPLE), and/or Instant Messaging and Presence Service (IMPS), andfor Short Message Service (SMS)), or any other suitable communication protocol, that facilitates communication between the server 102 and the client device 104.
1002fl In FIG. IA_ the server 102 and the client device 104 are illustrated as including a respective processor 116 or 18: a respective memory 130 or 122; and a respective communication module 134 or 126, In the following discussion, elements of the server 102 are described with reference to FIG. IA. Respective elements and/or reference numbers related to the client device 104 are shown in parentheses. Where appropriate, elements of the client device 104 arc described separately, 100221 The processor 116 (118) provides processing functionality for the server 102 (client device 104) and may include any number of processors, micro-controllers, or other processing systems, and resident or external memory fOr storing, data and other information accessed or generated by the server 102 (client device 104), The processor 116 (118) may execute one or more softwiare programs which implement techniques described herein. 'Die processor 116 (118) is not limited by the materials from which it is formed or the processing mechanisms employed therein and, as such, may be implemented via semiconductor(s) and/or transistors (es, electronic integrated circuits (ICs)). and so forth.
[0023j .. The memory 120 (122) is an example of tangible computer-readable media that provides storage functionality to store various data associated with the operation of the server 102 (client device 104), such as the software program and code segments mentioned above, or other data to instruct the processor 116 (118) and other elements of the server 102 (client device 04) to perform the steps described herein. Although a single memory 120 (122) is shown, a wide variety of types and combinations of memory may be employed.
The memory 120(122) may he integral with the processor 116 (118). stand-alone memory, or a combination of both. The memory may include, for example, removable and non removable memory elements such as RAM, ROM, Flash (e.g., SD Card, mini-SD
card, micro-SD Card), magnetic, optical, tiSB memory devices, and so forth.
00241 The communication module 124 (126) provides functionality to enable the server 102 (client device 104) to communicate with one or more networks (depicted in FIG. IA
as network 106). In various implementations, the communication module 124 (126) may be representative of a variety of communication components and functionality including, but not limited to: one or more antennas; a browser; a transmitter and/or receiver (e,g_ radio frequency cineuitly); a wireless radio: data ports: software interfaces and drivers;
networking interfaces; data processing components; and so forth.
100251 The one or more networks 106 may be representative of a variety of different communication pathways and network connections which may be employed, individually or in combinations, to communicate among the components of the environment 100. Thus.
the one or more networks 106 may be representative of communication pathways achieved using a single network or multi*. networks, Further, the one or more networks 106 are representative of a variety or different types of networks and connections that are contemplated, including. hut not limited to: the Internet; an intranet: a satellite network; a cellular network:, a mobile data network; wired and or wireless connections;
and so forth.

10026) Examples of wireless networks include, but are not limited to: networks configured for communications according= to: one or more standard of the Institute of Electrical and Electronics Engineers (IEEE), such s 802.11 or 802.16 (Wi-Max) standards; Wi-Fi standards promulgated by the Wi-FiAlkane Bluetooth ,standatds promulgated by the Bluctooth Special Interest Group; and so on, Wined communications are also contemplated such as through universal serial bus (US/3), Ethernet, serial connections, and so forth.
10027I As shown in FIG. A. the client device 104 includes a much-sensitive display 132, which can be implemented using a liquid crystal display, an organic light emitting diode display, or the like in some embodiments, the toue.h-sensitive display 132 may include a touch panel 134, The touch panel 134 may be, but is not limited to: a capacitive touch panel a resistive touch panel, an infrared touch panel, combinations thereof, and the like.
Thus, the display 132 may be configured to receive input from a user and display information to the user of the client device 104. For example. the display 132 displays visual output to the user. The visual output may include graphics, text, icons, video, interactive fields configured to receive input from a user, and any combination thereof (collectively termed -*zip/lies"). In some embodiments, some or all of the visual output may correspond to user-interface objects. further details of which are described below., 100281 The display 132 is communicatively coupled to a display controller 136 that is configured to receive and/or transmit electrical signals to the touch-sensitive display 132, In an implementation, the touch panel 134 includes a sensor, an array of sensors, or the like, configured to accept input from a user based upon haptic and/or tactile contact. The touch panel 134., in combination with the display controller 136 (along with any associated modules and/or sets of computer-readable instructions in memory t 22), detects a point of contact (or points of contact), as well as any movement or breaking of the contact, on the touch panel 134 and converts the detected contact (e.g., a finger of the user, a stylus, etc.) into electrical signals representing interactions with user-Interface objects (e.g., buttons, custom views, icons. web pages, images, web page links, etc.) that are displayed through the display 132. The client device 104 may further include one or more input/output (I/O) devices 138 (e.g.. a keypad, buttons, a wireless input device, a thumbwheel input device, a trackstick input device, and so on), The I/O devices 138 may include one or more audio I/O devices, such as a microphont, speakers, and so on. Thus, 110 devices I 38 may include a keyboard configured to receive user input. In an implementation, the keyboard may be integrated with the client device 104, or the keyboard may be a peripheral device that is configured to interface With the device 104 (e.gõ via a US13 port, etc.)..
10029] The client device 104 is illustrated as including a user interface 142, which is storable in memory 122 and executable by the processor 118. The user interface 142 is representative of functionality to control the display of information and data to the user of the client device 104 via the display 132. In some implementations, the display 132 may not be integrated into the mobile electronic device and may instead be connected externally using universal serial bus (USR). Ethernet, serial connections, and so forth.
The user Interface 142 may provide functionality to allow the user to interact with one or more appliCatiOrIS 144 of the client device 104 by providing inputs via the touch panel 134 and/or the I/O devices 138, For example, the user interface 142 may cause an application programming interface (API) to be generated to furnish functionality to an application 144 to configure the application for display by the display 132 or in combination with another display. In embodiments, the API may further furnish functionality to configure the application 144 to allow the user to interact with an application by providing inputs via the touch panel 134 and/or the II0 devices 138, 100301 Applications 144 may comprise sollware, which is storable in memory 122 and executable by the processor 118, to perform a specific operation or group of operations to furnish specified functionality to the client device 104.
i00311 As shown, the computing device 102 and/or the client device 104 may be in communication with one or more image capture devices 146. The image capture devices 146 comprise devices (e.g., cameras) for capturing images and/or videos. For instance, the image capture devices 146 may be configured to capture anatomic and/or clinical laboratory specimens and provide image data representing the captured imagery to the computing device 102 and/or the client device 104. In one or more implementations, the Image capture device 146 is configured to generate image including one or more spectral characteristics of the anatomic and/or clinical laboratory specimens. In one or more implementations, the image capture device. 146 is configured to generate image including one or more hue characteristics of the anatomic and/or clinical laboratory specimens.

(0032j As shown in FIG. IA, the server 102 includes a quality measurement module 148 that is storable in the memory 120 and executable by the processor 116, The quality measurement module 148 is representative of functionality to generate a quantitative metric based upon one or more selected quality metrics corresponding to an anatomic pathology tissue sample. For example, as described in greater detail below, the server 102 receives the quality metrics from one or more diem devices 104, In response, the quality measurement module 148 generates a quantitative metric corresponding to the quality metrics, [0033j in one or more implementations, the system 100 may comprise a Health Insurance Portability and Accountability Act (HIPPA) compliant cloud-based computer architecture for managing and measuring external quality assurance review. Initially, a pathology practice (e,g., a pathology professional, a group of pathology professionals) identifies and selects a case (e.g., an anatomic pathology tissue sample) for quality assurance review based on defined criteria and published recommendations of The Association of Directors of Anatomic and Surgical Pathology (ADASP). These recommendations take into consideration the structure, responsibilities, and needs of academic anatomic pathology laboratories that have an active residency or fellowship. These recommendations can be modified according to specific institutional circumstances and needs.
100341 Depending on departmental resources, a number of methods may serve as quality assurance case reviews including; review of a randomly selected percent of cases (e.g., 1%, 2%. 5%, 10% depending on the sin a practice and available sta Mune to conduct reviews), 11)0351 In one embodiment, a minimum of twenty cases per pathologist can be submitted to ensure statistical significance is maintained for quantitative analysis and comparison bk.'nehmarkintz. Objective data relative to the case (e.g., data representing imagery of the anatomic pathology sample captured by the image capture devices 146, data representing turn-around-time related to the anatomic pathology sample, data representing a diagnosis related to the anatomic pathology sample) is aggregated, collated. and converted in digital fbrmat as an e-ease for upload via a secure network (e.g.. network 106) to the server 102 via a client device IN, 036) One the upload of the data corresponding to the case is completed, a quality assurance analysis is performed by the server /02. For example, the server 102 automatically applies :a digital slide analysis to the image data representing the anatomic pathology sample to assess image attributes- and the completeness of the objective data submission as described in greater detail below. If the quality of the digital slide is hsufficient. a visual qualitative assessment is performed to provide an objective measure or score for quality. The associated scores are: I Gond:- 2 = Adequate; and Unacceptable, If the digital slide (e.g, image data of the anatomic pathology specimen) is rejected, the anatomic pathology practice can prepare a new glass slide, reimage the sample.
within the glass slide, and resubmit the data, representing the updated imagery. via the client device 104, 10(071 In another implementation. as shown in F1a...1A, the sever 102 is communicatively connected to a staining device .149. Tile :staining device 149 comprises a device that can apply a .Stain to the specimen. For example, the staining device 149 can apply a variety of staining compounds (e.g,, stain) to the specimen.. For instance, the staining compounds can comprise biological stains such as antibodies or chemical -stains including dyes and pigments. The staining device 149 includes a staining 'head 151 that can be positioned proximate to .the specimen. Once the staining. head 151 is positioned proximate to the Specimen, the staining head 151 can disperse the stain. In some implementations, the image Capture device 146 is integral with the staining device 149. In other implementations, the staining device 149 and the image capture device 149 are discrete devices, 100381 As shown in. FIG. IA, the server 102 includes an image analysis module i50, which is storable in the memoty 120 and cxectitable by the processor 1-16. The image analysis module 150 is representative of functionality for identifying tumor tissue(s) based upon the provided image data. in an implementation of the present .disOlosure, if the digital slide is of insufficient quality, the module 150 transmits a request to the client device 104 over the network 106. The request can automatically cause the user interface 142 of the client device 104 to display a. graphical interface requesting submission of a new digital slide. If the quality of the slide image is sufficient for quality review, then the digital slide can be analyzed and interpreted by the reviewing pathologist t00391As des-cribed. .above, the image analysis module 150 provides functionality to identify one or more pixels as corresponding to a. tumor tissue. For instance, the processor 116 can compare pixels of the digital image. representing the specimen to one or more pixels (e.g.. adjacent pixels) of the digital image to compare one or more characteristics of the pixels. In an implementation, the processor 116 iterates through the digital image comparing pixel characteristics, Based upon one or more pixel characteristics.
.the processor 116 can identify (e.g.., determine) a region of interest that may correspond to tumor tissue. The image analysis module 150 retains information to cause the processor 116 to identify regions of interest within the digital image of the -specimen, in implementations, the processor 116 is configured to identify regions.of interest based upon an identifying characteristic (e.g.. the pixels having a hue characteristic corresponding to purple). Thus, the processor 11.6 iterates through the digital image to identify regions of interest where pixels within that region of interest have characteristics corresponding to .the identifying characteristic. For instance the hue (color) characteristics of the pixels within the region of interest may differ from the hue characteristics of pixels not within the region or interest. For instance, the hue (color) characteristics of the pixels within the region of interest are purple (dueulstaining nf the specimen), and the hue characteristics of the pixels outside the region of interest differ substantially (e.g., the hue characteristics correspond to pink, etc.). Thus, the pixels having characteristics that At least substantially match the identifying characteristic are deemed to be within the region of interest. As described above,. the pixels within the region of interest may be indicative of .tumor tissue within the specimen.
10040] Upon determining. a region of interest Within the digital image, the image analysis module ISO provides =functionality to determine an image quality of the digital image of the specimen. In .one or more implementations. one or more baseline characteristics may be stored in the database 1.52. In an implementation, the baseline characteristics may comprise baseline digital images having regions of interest. The baseline digital images comprise digital images having baseline pixel characteristics (es, the baseline pixel characteristics of the regions of interest). in another implementation, the baseline characteristics may ,comprise baseline data corresponding to pixel characteristics. For -instance. the baseline characteristics may comprise hue characteristics indicating an acceptable image quality (e.g., the pixels indicative of tumor tissue are sufficiently purple).
For example. the baseline digital images may represent specimens having tumors therein, and the regions of interest correspond to the tumors, 10041j The image analysis module 150 provides functionality to compare a characteristic of al least one pixel within the identified region Of interest the baseline characteristics to determine whether the pixels within the identified region are above a threshold. Pixels within identified region having characteristics at or exceeding the threshold may comprise pixels indicative of sufficient image quality. In an implementation, the threshold may comprise a value indicative of a suitable hue characteristic. For example, the processor 116 determines whether a hue characteristic of a pixel within the identified region is equal to or exceeds the baseline characteristics. Thus, the processor 116 can compare a hue characteristic of the digital image provided by the client device 104 to a similar hue characteristic of the baseline digital image to determine the image quality of the digital image. In response, the processor 116 determines whether the image quality of the digital image is sufficient. In some instances, the processor 116 generates a score corresponding to the difference in the hue characteristics between the pixel within the identified region and the baseline characteristics (e.g., the hue characteristics of the digital image is within ten percent (10%) of the hue characteristics of the baseline characteristics).
Digital images of insufficient quality may comprise pixels having hue characteristics that are less than the hue characteristics of the baseline image (e.gõ the pixels are "less-144411e with respect to the baseline characteristics), which may be indicative of insufficient stain applied to the specimen.
100421 In instances, where the server 102 deems the digital image to be of insufficient quality (a4õ pixels within the identified region of interest have characteristics below the quality threshold), the server 102 can cause the staining device 149 to re-apply stain to the specimen. For instance, the server 102 may cause the staining device 149 to re-apply the stain in real-time or near real-time (e.g,, causing re-application of the stain upon determining an image of insufficient quality),. Once the stain has been re-applied to the specimen, the server 102 causes the image capture device 146 to capture another digital image of the specimen in real-time or near real-time. Thus. the server 102 can transmit a Signal causing the staining device 149 to re-apply the stain and causing the image capture device 146 to capture another digital image of the specimen when the server determines that the original digital image is not of sufficient quality. In sonic instances, the server 102 can Om re-orientation of the staining device and/or the image capture device 146. (e.g., the server 102 is operablycoupled to at least one of a.
mechanical -component of the image capture device 146 or an electro-mechanical component of the image capture device 146). For instance, the server 102 can issue cOmmands over the network 106 to cause the image capture device 146 to _adjust an angle of incidence with respect to the specimen (e,g., cause the image capture device 146 to re-orient itself with respect to the .specimen to after the -angle of incidence). In some implementations, the server 102 can cause theimage:capture device 146 to adjust a magni.ficat ion characteristic of the image capture device 146. For instance, if the =image quality of the digital image is =
determined to be insufficient, the server 102 can issue one or more.commands to cause the.
image capture device 146 to adjust a magnification characteristic (e,gõ a higher magnification characteristic, a lower magnifica.tion =Characteristic, etc) compared to the magnification characteristic of the original digital image. This. process may continue until the server 102 -determines that the digital image is of sufficient quality 100431 Once a digital image of sufficient quality has been -provided, the image analysis module 150 applies qualitative and quantitative image analysis (92IA) and enhancement to Measure the quality of the digital slide te.g., the digital image of .the anatomic pathology specime.n, the image data representing .the anatomic pathology specimen). For example, the colors of stains can be enhanced by the module 1,50 or even changed to provide more color contrast in counterstained -samples, In an implementation, the -quality analysis module 150 comprises a suitable image analysis 'module (e.g., a TiSsue_Mark0 image analysis tool. or the like) that generates a quantitative visualization of tumor probability for regions within the marked-up boundary. Regions of high tumor probability may be labeled red and regions of low tumor probability may be labeled pale blue/transparent.
This quantitative visualiziation allows highlighting areas ,of non-tumour such as stromaõ
inflammation, and necrosis that are included within the macrodissection boundary. After the quality is determined and image analysis of the digital image (e.g., image data) is performed, the digital slide can then be analyzed and interpreted by a reviewer (e,g., by a.
sub-specialty expert pathologist) who views the digital slide at the user interface at a client device 104 communicatively connected to the server 102 1,00441 'Furthermore, the reviewing expert pathologist - analyzes and interprets the digital slide for diagnostic accuracy compared to the original subjective interpretation rendered by the submitting pathologist. An expert interpmtation is recorded from the reviewing subspecialist via a client device 104 and stored as a reviewer quality data management data input (e.g., a metric as described in greater detail below) within a database 152 of the server 102 for further processina by the module 148. For instance, the reviewing pathologist transmits an assessment of an image attribute of the specimen. The attribute (e.g., assessment metric). for example, may comprise indications of cancer, disease, or the like.
The assessment may comprise a diagnostic accuracy review measured as one of the standard and/or acceptable values. For instance, the assessment (eõg., feedback, etc.) may comprise: (1) Concordant: Preferred diagnosis is substantially identical with the target diagnosis', (2) Concordant with Comments: Would like to add a comment or provide some constructive feedback to the case: (3) Minor Discordant: Disagreement not clinically relevant (4) Discordant: Disagreement, clinically relevant, but does not change the original diagnosis; and (5) Major Discoidanec: Disagreement that may result in a change in the diagnostic report and impact patient care.
10045] In another implementation, the server 102 includes an image determination module 15$ that is stored in the memory 12,0 and executable by the processor 116. The image determination module 153 represents functionality for determining an image attribute of the digital image. The database 152 retains multiple digital images (e.g., a library of digital images) representing already completed cases. For example, these digital images may comprise images of a specimen where a final determination (e.g., previously analyzed) has been made regarding the specimen (e.g., cancer, disease, etc.), The database 152 can retain associated information with each digital image indicting the. final determination (e ,g.õ
reference digital images). For example, the reference digital images include metadata associated therewith such that the metadata provides the final determination.
The image determination module 153 can cause the processor 116 to determine an image attribute of the current digital image based upon a comparison with one or more reference digital images. For instance, as described above, the processor 116 identities a region of interest.
The processor 116 can compare the characteristics of the pixel within the identified region with characteristics of corresponding pixels within a region of interest in the reference digital images. For example, thc captured digital image comprises an image representing a specimen having a tumor therein. The processor 116 identifies a subset of pixels as representing the tumor (e.e, the region of interest) based upon the characteristics of the pixels representing the tumor with respect to the characteristics of the pixels representing the remaining portion of the specimen. The processor 116 then compares at least one pixel characteristic of a pixel within the identified region with a pixel characteristic of a pixel of at least one reference digital image. In some implementations, the processor 116 compares the pixel characteristic with a pixel characteristic of :a pixel within an identified region of a group of reference digital images. For example, the processor 116 compares the pixel characteristic with a pixel characteristic of a pixel within an identified region of each reference digital image. In some implementations, the processor 116 (e.g., server 102) can cause the image capture dc a. 146 to adjust a magnification characteri,stic such that the image capture device 146 generates a digital image corresponding to the region of interest with the magnification characteristic, For example, once the region of interest is identified within a first digital image, the processor 116 causes the image capture device 146 to capture and generate a second digital image of the specimen having a different magnification characteristic with respect to the first digital image. For instance, the second digital image may have a higher magnification characteristic of the region of interest compared with the first digital image.
(0461 In sonic implementations. a spectral analysis may be applied to the:
digital image.
For instance, the processor 116 may select one or more pixels within the identified region and apply a Fast Fourier transform to these pixels to generate a spectral representation of the pixels. In the implementation described above, the processor 116 can generate a spectral representation corresponding to the tumor.
11110471 Based upon this comparison, the processor 116 determines an image attribute of the identified region. For example, based upon the comparison, the processor 116 determines whether the pixel within the identified region comprises cancer, disease, or the like. The processor 116 can then compare the determined image attribute with the image attribute provided by the client device 104 and provide a metric associated therewith.
In an implementation, the processor 116 generates an assessment metric based upon the comparison of the processor determined image attribute and an image attribute provided by the client device 104> For instance, the image attribute provided by the client device 104 may comprise data representing a decision by a pathologist regarding the specimen (e.gõ, cancer, disease, etc.). Thus the processor 116 compares theprocessor 116 generated image attribute with an attribute of the specimen provided, by the client device 1K For example, if the determined image attribute matches the provided image attribute, the processor 116 generates an assessment metric indicating that the determined image attribute and the provided image attribute are concordant, lithe determined image attribute does not match the provided image attribute, the processor .116 generates an assessment Metric indicating discordant or major discordance.
100481 Diagnostic Confidence indicates whether the case had a second review prior to sign-out which may have been a formal consult or an informal reviewõ Results of the consult or review can be found in the case notes. In implementations, the server 102 receives data from the client device 104 corresponding to Diagnostic Confidence. For instance, the server 102 can be provided data corresponding to the instant case that includes information of whether, prior to sign-out, the case had a second review. Based upon this data, the server 102 generates ametric representing a Diagnostic Confidence.
For instance, the .metric may represent a score of one (1) indicating a second review of the case did occur or zero (0) 'indicating a second review of the case did not occor In sOme instances, based upon previous submissions of the pathologist the server 1.04 can apply confidence interval ranking to the Diagnostic Confidencemetric. In these implementations, the database 152 Maintains previous submissions provided by the pathologists such that the processor 116 can compare currently submitted data against previously Submitted data and previously generated metrics and/or scores. For instance, in the event this pathologist has submitted cases having a second reviewbut the second review was diScordant, the processor 116 can generate a metric that is lower that a metric where the pathologist has submitted cases having a second review and the: second review was concordant with the initial diagnosis.
Thus, the processor 116 .can generate a confidence interval related to these metrics and apply the confidence interval to any newly generated Diagnostic Confidence metrics 100491 Clerical Accuracy, may include, but is .not limited, to accurate tracking of the .'specimen from collection to analysis ensuring no mix-up of .the specimen occurs. Thus, = the client de V ice 104 can provide the server 102 with data representing a log that represents tracking of the specimen from collection to analysis. Additionally, clerical accuracy may also include accuratety recording the diagnosis from the specimen into the appropriate file Based upon this information, the server 102 is configured to generate a Clerical Accuracy parameter (e.gõ. Metric) indicating whether The Clerical .Accuracy parameter (c,g,4 parameter representing the clerical accuracy) is recorded in the database. 152 ..as: (1) Concordant Preferred. diagnosis is substantially identical with the target diagnosis; (2) Concordant With Comments: Would like to add a. comment or provide constructive feedback-to the clerical component of the case (3) Minor Discordant: Clerical Inaccuracy relevant; (4) Discordant.Clerical= inaccuracy. Clinically relevant, but does not change the diagnosis; or (5) Major Discordant: Clerical inaccuracy that may result in a.
change in .the initial diagnostic report. For instance, the processor 116 generates a Clerical Accuracy metric based upon data within the log and/or information provided by the client device 104. In some implementations. the processor 116 identifies whether the specimen was accurately recorded at each transaction point within the collection to analysis chain (e.g.. whether specimen was recorded at COiketiOIL whether specimen was recorded at imagiag, whether specimen was recorded at analysis, etc,), Thus, the log can contain data corresponding to each recordation (e.g., check-in) at each transaction point within the chain. r the server 102. determines that the specimen was properly recorded at each transaction point, the server 102 generates .a .first metric, and lithe server 102 determines that the specimen was not properly recorded At each transaction point, the server 102 generates. a Second metric that is lower than the first metric.
100501 Furthermore, Turn around Time (TAT) is based on a computerlenerated time from the case actesSion time and the pathology Case sign out time, In Some instances,, the time may he measured in seconds, minutes, or hours. Turn around time may include case accession, the time the specimen is collected to pathology case sign out.
time, and/or the lime the submitting pathologist provides a diaanosisõAs an absolute value, TAT
is normalized by grouping in reports lahOratories with similar service hours and case complexity, in one or more implementations, the server 102 generates a TAT
metric by measuring one or more time characteristics associated with the case As described above, the client device 104 provides a log corresponding to the case. The log can contain data representing a time characteristic associated with each portion of the case.
Thus, the client device 104 can measure and record one or more time characteristics corresponding to case accession time to sign out time. The processor 1 16 is.configurectto.generate a Turn around time metric based upon the recorded time characteristics. =
1005Ij In one embodiment, the quality measurement module 148 aggregates the automated assessment .and objective assessment (e.g., input data) provided by the reviewer of the case comparatively against a predefined set of criteria. The modtile-'148. provides 'functionality that can support .the pathologist through a clinical decision support 'function that guides the.
pathologist through the process of making an interpretation or opinion in order to arrive at a concordance or discordance ft-n- the slide (e.g., image data representing the anatomic pathology specimen) and overall case.
100521 In one embodiment of Fla IA. quality assurance module 148 generates a Uniqw Professional Practice Score (PPS) utilized to benchmark quality performance in pathology and for medical practice continuous improvement, The PPS score comprises five

(5) quality metrics that have a role in reducing diagnostic error, For example, .one or more of the metrics may comprise confidence levels, diagnostic accuracy, image attribute, applied rime, and completeness of infbrmation (e,gõ whether required data for a case has been = completed by the pathology practice or received at the server 102).
00531 In one or more implementations. the server 102 is communicatively connected with the client devices 104. The client devices 104. in pariõ'serve to provide 'access to the quality' measurement module 148: for the subspeCialist reviewing pathologist such that the subSpecialist reviewing pathologist can upload the input data representing one or more of the quality metrics,. Thus. e the .server 102 can .provide 'functionality to:
(I) Host case data information and digital slide images; (2): Serve as an application host site for subsPecialist to complete the case review; (3) Generate the graphical representations and provide clinical alerts 'fbr Major Discordant Reviews; and (4) Create observational data storage ism future data mining and longitudinal aottlytics. Additionally.. as described .above, =
the quality measurement module 148 accesses the metrics generated by the server 102 as deseribed above:
(40-541 With regards to metrics. having Major Discordant Reviews from the reviewing .pathologiSt the quality measurement module 148 can automatically generate an alert 200 (see FIG. 1B) indicating that a. Major Discordant Review has been received for the respective metric and automatically issue the alert to the appropriate client device 104. The client device 104, upon receiving the alert 200, can automatically generate a window 202 at an unobscured portion 204 (e.g., information within the window 202 is viewable to the end user) (tithe display 132 such that an end user can be notified of the Major Discordant Review and employ necessary steps to remedy the situation for the patient. In an implementation, the alert may comprise textual information 206 regarding the Major Discordant Review and relevant identifying information regarding the ease.
10055j hi one embodiment, the quality measurement module 148 applies a process for weighting of clinical concordance or discordance for both the submitting pathologist input of objective numeric and clerical values and subspecialist reviewer contribution of interpretation values of concordance and discordance to calculate and generate a Practice Proficiency Score, Discordance is applied through a weighted value based on a risk factor of contribution to clinical discordance and effect on patient care. A grading scheme is applied by the quality measurement module 148 that assigns a discrete value relative to what harm or potential harm may result from the interpretive error.
Consideration can he given to communicating to risk management any error that has significant harm or impact on patient care. For example, the grading scale may comprise; No harm or impact on patient care (Labeled as "Minor Discordance") and grade 3; slight harm or impact on patient care (Labeled as "Discordance") and grade" 5; and significant harm or alteration of clinical management (Labeled as 'Major Discordance') and grade = 10, The Practice Proficiency Score comprises the normalized weighted mean of the five (5) quality metrics identified above. The Practice Proficiency Score can be determined as follows;
wi EON. 1 10056t By detecting and analyzing variability in the Practice Proficiency Score, health care providers can access pathologist proficiency and guide continuous improvement initiatives to reduce diagnostic discordance. The Practiee Proficiency Score is uniquely applied to the pathologist andi`or laboratory under review by plotting the Practice Proficiency Score in a benchmark funnel graph against a uniquely created experience curve based upon years of experience and monthly caseload by tissue type (see FIG, 2).
00371 Once the Practice Proficiency Score has been generated by the module 148, the module 148 can transmit an alert 200 to the corresponding pathologist(s) (cg, the pathologist(s) corresponding to the case), In one or more implementations, as shown in =

FIG, C. the alert 200 comprises.a Uniform Resource Locator (tin) link 21a that provides access to the Practice. Proficiency Score .and one or more reports (as described below and shown in FIGS. 2 through 5) that reside on the server 102. Once the respective pathologist.
interfaces with the URI, link 210, the URL link 210 causes display of the one or more reports corresponding to the Practice Proficiency Score at the display 132 of the client device 104. In some implementations, once the client device 104 has communicatively connected to the server 102 via the network (e,g,õ establishes a communication lInk, etc,), the module 1.48 may .autotnatiCay Cause one or more reports corresponding to the .Practice Proficiency Score to be displayed at the display 132 (e,gõ, user interfitee 142) of the client device 104õ
(00581 Thequality measurement module 148 =.can..also be representative of generating and providing reports and constructive feedback to the pathologist-and/or pathology group, The reports corresponding to the anatomic pathology specimen are generated based on pre-defined:.criteria and/or can be created ad-hoc based .on queries generated by the end user through the user interface. 142 of the client device 104. In some implementations, the quality MeasureMent module 148 automatically gmeniteS a report in response to a request from the client device 104. In some instances, the report is based upon pre-defined parameters set forth in a user prOfi le 154. For instance, a user profile 1_54 may beretained at the client device 104. and the user profile 154 may store one or more parameters defining reporting criteria for report generation. This user profile 154 may also be stored in the server 101 In some .embodiments, each time the client device 104 interfaces the server 102, the quality measurement module 148 determines whether any updates have been made to.parameters set forth in the user profile 154 if so. the quality measurement module 148 automatically updates the corresponding parameters in the user profile 154 stored in the server 102. in other embodiments. the quality measurement module 148 generates reports dynamically te.44.õ ad-hoe) based upon one or more requests from an end user.
For instance, an end user may generate a first request for a first report by submitting the first request through a client device 104. to the server 102, In response, the module 148 generates a report based upon the .first request (e.gõ according to the parameters set forth in the 'first request). In another instance, an end user {c,g,, a different end user or the same end user) may generate a second request for a second report by submitting the second request through a client device 1.04 to the server I OI in response, the module 148 generates a report based upon the second request (cg., according to the pat-ameters set lbrth in the second request), 10-05.11 In an embodiment, the quality measurement module. 148 generates one or more visual repre$CtitatiOrIS of the Practice Proficiency Score. In some embodiments, the reports may, in part, comprise the visual representations of the Practice Proficiency Score. For instance, the module 148 can generate a -multivariate, graph of ease review Metrics and individual assessment metries.cotTesponding to the Practice Proficiency Score, which can be stored longitudinally for qualitative.and.comparative analysis (see FIG, 3), The visual representations may comprise a graphical .method of displaying multivariate data, metrics, in the form of a two-dimensional chart of three Or more quantitative variables represented on axes starting from the same point. The star graph displays the performance metrics of the ongoing quality assurance program. At a glance, the pathologist member can interpret the following information based on plus or Minus two (2) standard deviations (+/- 2SD) from the norm of the group: diagnostic accuracy, clerical error, case complexity, diagnostic confidence, and image attributes which are relative to their risk adjusted peer group, [4)060i The server 102 includes a bene-hmarking module 156, which is stored in the.
memory 120 and executable by the processor 116. The benchntarking modulo 156 provides a comparative analysis of the Practice Proficiency Score of one Pathologist or laboratory with corresponding (e.g.. "best match") peers of the same category, experience and specialty. A Pathologist's Mean Practice Proficiency Score is determined awl compared to the peer group, 4I 2SD. using a Stock Graph or Pathologist's Resume, The Resume provides longitudinal comparison by specialty peer group, 10061.) Furthermore, as shown in FIG, 4. the comparative analysis generated by the benchmarking module 156 is applied to. torn around time (TAT) versus case complexity.
This is -a Kaplan-Meier plot of multivariate analysis- based on case complexity and Turn around-Time. Case complexity, for example, relates to the type of specimen analyzed..
Case complexity is determined by the highest assigned CPT code and broken out in the -following manner: Qualifiers for comparatives are based on .five (5) day or seven (7) day laboratory operations. Additional variables are applied to calculate case complexity, which may include immunohistochcmical (111C) stains and molecular tests. Bone decalcification cases are omitted as qualifiers for complexity. The case is calculated using the site TAT

times for all eases submitted, regardless if the site is made up of a single pathologist or a group of pathologists, i00674 In one or more implementations. the benchmarking module 156 provides benchmarking for pathologist and or group Practice Proficiency Score at six

(6) month intervals. On a six-month basis, longitudinal quality assurance reports demonstrate changes in the PPS of the individual practitioners total casts submitted, which allows an objective perilbrmance evaluation over time. Pathologists can track their performance levels on a -timelier basis, and support the institution's efforts in creating an evidence-based process for credentialing. Interpretation based on longitudinal Practice Proficiency Score for each member Practice Proficiency Score is displayed graphically over time, and a trend line is generated. Pathologists can review the graph to evaluate which area had the greatest effect on the change of their longitudinal performance. The mean of the peer group, and the individual axes are adjusted to generate a symmetrical square for ease of interpretation.
100631 FIG, 6 illustrates an example method 600 for generating a Practice Proficiency Score corresponding to a specimen in accordance with an example implementation of the present disclosure. The Professional Practice Score is generated based upon the metrics described herein. As described above, each metric measures an objective aspect t)f a ease corresponding to a specimen based upon the pathologist submitting the case. As diseued above, the specimen may comprise an anatomic pathology specimen, a histologic specimen, a clinical specimen, a blood film, a microbiology specimen, or the like. As shown in FIG, 6, the method 600 includes recess mg an assessment of an image attribute metric of a digital image of a specimen (Block 602), For example, data representing a digital image and/or data representing an assessment relating to an image attribute of the digital image is received at a server 102 from a diem device 104 over a network 106. In an implementation, the data representing the digital image is generated by an image capture device 146. As discussed above, an assessment related to (e.g., pertaining, to, corresponding To) the digital image is provided to the server 102. The assessment may comprise a diagnosis pertaining., to the specimen, The quality measurement module 148 may utilize this assessment as described above, to determine a Professional Practice Score relating to the specimen. Additionally, as described above, th server 102 detennines an assessment relating to the image attribute. For instance, the server 102 can compare image characteristics of the digital image to one or more baseline image characteristics of baseline image characteristics.
00641 As shown in FIG. 6, a diagnostic confidence metric corresponding to the specimen is received (Block 604). In one or more implementations, a diatmostic confidence relating to the specimen is received at the server 102. Diagnostic confidence CompriSeS
data indicating whether the case had a second review prior to sign-out which may have been a formal consult or an informal review, 100651 A diagnostic accuracy metric corresponding to the specimen is received (Block 606), In one or more implementations, diagnostic accuracy comprises data representing an interpretation by a reviewing pathologist of information regarding the ease (e.g., the specimen). For instance. the reviewing pathologist may provide a diagnostic accuracy that comprises (1) Concordant: Preferred diagnosis is substantially Identical with the target diagnosis; (2) Concordant with Comments: Would like to add a comment or provide some constructive feedback to the case: (3) Minor Discordant: Disagreement not clinically relevant: (4) Discordant: Disagreement, clinically relevant, hut does not change the original diagnosis; and (5) Major Discordance: Disagreement that may result in a change in the initial diagnOstic report and impact patient care.
[00661 As shown in FIG. 6, a turn around time metric corresponding to the specimen is received (Block 608). As discussed above, the turn around time comprises the time from the case accession time and the pathology case sign out time and is received at the server 102 from the client device I 04. As described above, the server 102 and/or the client device 104 are configured to measure the turn around time. A CleriCal accuracy metric corresponding to the specimen is received (Block 610). In one or more implementations, the clerical accuracy comprises accurate tracking of the anatomic pathology specimen from collection to analysis ensuring no mix-up of the specimen occurs.
Additionally, clerical accuracy- may also include accurately rceording the diagnosis from the specimen into the appropriate file. Clerical Accuracy parameters are recorded and stored in the database 152 by the it sta./specialist t,e g reviewMg pathologist). Additionally the server 102 is configured to iterate through information pertaining to the specific case and determine a clerical accuracy based upon one or more defined characteristics within the information.

100671 A score representing a proficiency corresponding to the specimen is generated (Block 412). in one or more implementations, the quality measurement module, generates a store that represents a proficiency corresponding. to :the specimen. As described above-, the score comprises a Professional Practice Score that measures a proficiency Of a pathologist (or pathologist group) with respect to a similar pathologist (or similar pathologist groups), and the score is based upon the metrics described above. in some implementations, the quality measurement module 148, once a client device 104 of a respective pathologist communicatively - connects with the server, automatically cans-es display of information including a Uniform Resource. Locator (URI.,) that provides access to the Practice Proficiency :Score and one or more reports representing a graphical visualization of the Practice Proficiency Score.
[00681 Generally, any of the functions described herein can be implemented using hardware (e,gõ fixed logic .circuitry such as integrated circuits), software, firmware, or a combination of these embodiments. Thus, the blocks discussed in the above disclosure generally represent - hardware (c.g.õ fixed logic circuitry such as integrated circuits), software, firmware, or a combination thereof: in the instance of a hardware embodiment, for instance, the various blocks discussed in the 'above disclosure may be implemented as integrated circuits .along with other funetionalityõ Such integrated circuits may include all of the functions of a given block, -system or Circuit, or a portion of the functions of the block, system or .circuit, .Further elements of the blocks,. systems or circuits may be implemented across multiple imegnued.circuits. Such integrated circuits may comprise various integrated circuits including. btn not necessarily limited to a monolithic integrated Circuit. a flip chip integrated circuit, a multichip module integrated circuit, and/or a mixed signal integrated circuit. In the instance of a software embodiment.õ-for instance, the various blocks discussed in the above disclosure represent executable instructions (ex.., program code) that perform specified tasks when executed on a processor. These executable instructions can be stored in one or more tangible computer readable media. In some such instances, the entire system, block or circuit may be implemented using its.
software or -firmware equivalent. in .other instances, one patt.of a given system, block, or circuit may be implemented in softWare.or-firinware, while other parts are implemented in 'hardware, Coclusion 10069i Although the invention has been described in language specific to structural features and/or methodological acts, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or aots described. Rather, the specific features and acts am disclosed as example forms of implementing the claimed invention.

Claims (20)

What is claimed is:

1. A method comprising:
determining, via a processor, a first image attribute of a digital image of a specimen based upon at least one pixel characteristic of the digital image, the digital image captured by an image capture device:
generating an assessment metric based upon a comparison of the first image attribute with a second image attribute provided by a client device;
receiving a diagnostic confidence metric corresponding to the specimen, the diagnostic confidence metric comprising an indication of whether a second review of the specimen occurred;
receiving a diagnostic accuracy metric corresponding to the specimen, the diagnostic accuracy metric comprising an accuracy indication of a diagnosis of the anatomic pathology specimen;
receiving a turn around time metric corresponding to the specimen, the turn around time metric comprising a time ranging from 4 case accession time to a case sign out time;
receiving a clerical accuracy metric corresponding to the specimens the clerical accuracy .metric comprising a clerical accuracy parameter pertaining to the specimen; and causing the processor to generate a score representing a proficiency corresponding to the specimen, the score based upon the, assessment metric, the diagnostic confidence metric, the diagnostic accuracy metric, the turn around time metric, and the clerical accuracy metric..

2.The method as recited in claim 1, further comprising determining, via a processor.
an image quality of the digital image; causing the image capture device to generate a second digital image of the specimen when the image quality is below a threshold.

3. The method as recited in claim 2, further comprising causing a staining device to apply a stain to the specimen when the image quality is below the threshold.

4. The method as recited in claim 2, wherein determining the image quality further comprises identifying a region of interest of the specimen within the digital image; and comparing an image characteristics of the region of interest with an image characteristic of the baseline region of interest within a baseline digital image.

5. The method as recited in claim 4, further comprising comparing a hue characteristic of a pixel within the region of interest with a hue characteristic of a pixel within the baseline region of interest.

6. The method as recited in claim 1, further comprising causing the processor to generate an alert; causing transmission of the alert to a client device, the alert comprising.
a Uniform Resource Locator link providing access to the score.

7. The method as recited in claim 1, wherein the specimen comprises at least one of an anatomic pathology specimen or a clinical laboratory specimens

8. A computing device comprising:
a memory operable to store one or more modules; and processor communicatively coupled to the memory and operatively coupled to an image capture device, the processor operable to execute the one or more modules to:
determine a first image attribute of a digital image of a specimen based upon at least one pixel characteristic of the digital image, the digital image captured by an image capture-device;
generate an assessment metric based upon a comparison of the first image attribute with a second image attribute provided by a client device;
receive a diagnostic confidence metric corresponding to the specimen, the diagnostic confidence metric comprising an indication of whether a second review of the specimen occurred;
receive a diagnostic accuracy metric corresponding to die specimen, the diagnostic accuracy metric comprising an accuracy indication of a diagnosis of the anatomic pathology specimen;
receive a turn around time metric corresponding to the specimen, the turn around time metric comprising a time ranging from a case accession time to a case sign out time;
receive a clerical accuracy metric corresponding to the, specimen, the clerical accuracy metric comprising a clerical accuracy parameter pertaining to the specimen; and generate a score representing a proficiency corresponding to the specimen, the score based upon the assessment metric, the diagnostic confidence metric, the diagnostic accuracy metric, the turn around time metric, and the clerical accuracy metric.

9. The computing device as recited in claim 8, wherein the processor is further operable to execute the one or more modules to determine an image quality of the digital image and causes the image capture device to generate a second digital image of the specimen when the image quality is below a threshold.

10. The computing device as recited in claim 9, wherein the processor is operably coupled to a staining device, the processor further operable to execute the one or more modules to cause the staining device to apply a stain to the specimen when the image quality is below the threshold.

11.The computing device as recited in claim 9, wherein the processor is further operable to execute.the one or more modules to identify a region of interest of the specimen within the digital image: and compare an image characteristics of the region of interest with an image characteristic of the baseline region of interest within a baseline digital image.

12. The computing device as recited in claim 9, wherein the processor is further operable to execute the one or more modules to compare a hue characteristic of a pixel.
within the region of interest with a hue characteristic of a pixel within the baseline region of interest.

13. The computing device as recited in claim 8, wherein the processor is further operable to execute the one or more modules to generate an alert and cause transmission of the alert to a client device, the alert comprising a Uniform Resource Locator link providing access to the score.

14. The computing device as recited in claim 8. wherein the specimen comprises at least one of an anatomic pathology specimen or a clinical laboratory specimen.

29 5. A system comprising:
an image capture device:
a client device;
a server configured to communicatively connect to the client device and operatively coupled to the image capture device over a network, the server comprising;
a memory operable to store one or more modules; and a processor communicatively coupled to the memory, the processor operable to execute the one or more modules to:
determine a first image attribute of a digital image of a specimen based upon at least one pixel characteristic of the digital image, the digital image captured by an image capture device;
generate an assessment metric based upon a comparison of the first image attribute with a second image attribute provided by a client device;
receive a diagnostic confidence metric corresponding to the specimen from the client device, the diagnostic confidence metric comprising an indication of whether a second review of the specimen occurred;
receive a diagnostic accuracy metric corresponding to the specimen from the client device, the diagnostic accuracy metric comprising an accuracy indication of a diagnosis of the anatomic pathology specimen:
receive a turn around time metric corresponding to the specimen from the client device, the turn around time metric comprising a time ranging from a case accession time to a ease sign out time;
receive a clerical accuracy metric corresponding to the specimen from the client device, the clerical accuracy metric comprising a clerical accuracy parameter pertaining to the specimen; and generate a score representing a proficiency corresponding to the specimen from the client device, the score based upon the assessment metric, the diagnostic confidence metric, the diagnostic accuracy metric, the turn around time metric, and the clerical accuracy metric.

16. The system as recited in claim 15, wherein the processor is further operable to execute the one or more modules to determine an image quality or the digital image and causes the image capture device to generate a second digital image of the specimen when the image quality is below a threshold.

17. The system as recited in claim 16, further comprising a staining device, the processor further operable to execute the one or more modules to cause the staining device to apply a stain to the specimen when the image quality is below the threshold.

18. The system as recited in Claim 16, wherein the processor is further operable to execute the one or more modules to identify a region or interest of the specimen within the digital image and compare an image characteristics of the region of interest with an image characteristic of the baseline region of interest within a baseline digital image.

19. The system as recited in claim 15, wherein the processor is further operable to execute the one or more modules to generate an alert and to cause transmission of the alert to a client device, the alert comprising a Uniform Resource Locator link providing access to the score.

20. The system as recited in claim 15, wherein the specimen comprises at least one of an anatomic pathology specimen or a clinical laboratory specimen.