US20140095567A1 - Rapid syndrome analysis apparatus and method - Google Patents
Rapid syndrome analysis apparatus and method Download PDFInfo
- Publication number
- US20140095567A1 US20140095567A1 US14/098,695 US201314098695A US2014095567A1 US 20140095567 A1 US20140095567 A1 US 20140095567A1 US 201314098695 A US201314098695 A US 201314098695A US 2014095567 A1 US2014095567 A1 US 2014095567A1
- Authority
- US
- United States
- Prior art keywords
- data
- cusum
- instructions
- days
- generating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 208000011580 syndromic disease Diseases 0.000 title claims abstract description 28
- 238000004458 analytical method Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 title claims description 28
- 230000004044 response Effects 0.000 claims abstract description 8
- 230000002354 daily effect Effects 0.000 description 10
- 201000010099 disease Diseases 0.000 description 10
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 10
- 238000004422 calculation algorithm Methods 0.000 description 8
- 230000035945 sensitivity Effects 0.000 description 5
- 238000007619 statistical method Methods 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 230000006872 improvement Effects 0.000 description 4
- 238000011534 incubation Methods 0.000 description 4
- 241001136653 Iris virginica Species 0.000 description 3
- 235000002971 Iris x germanica Nutrition 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 241000408659 Darpa Species 0.000 description 2
- 241001633663 Iris pseudacorus Species 0.000 description 2
- 230000001186 cumulative effect Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 208000006454 hepatitis Diseases 0.000 description 2
- 206010022000 influenza Diseases 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 231100000189 neurotoxic Toxicity 0.000 description 2
- 230000002887 neurotoxic effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000003442 weekly effect Effects 0.000 description 2
- 208000035473 Communicable disease Diseases 0.000 description 1
- 208000010201 Exanthema Diseases 0.000 description 1
- 208000018522 Gastrointestinal disease Diseases 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 101710198277 RNA polymerase sigma factor sigA Proteins 0.000 description 1
- 206010068142 Radiation sickness syndrome Diseases 0.000 description 1
- 206010040047 Sepsis Diseases 0.000 description 1
- 241000700647 Variola virus Species 0.000 description 1
- 231100000481 chemical toxicant Toxicity 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 208000009190 disseminated intravascular coagulation Diseases 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 206010014599 encephalitis Diseases 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 201000005884 exanthem Diseases 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 230000002496 gastric effect Effects 0.000 description 1
- 231100000283 hepatitis Toxicity 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 230000002458 infectious effect Effects 0.000 description 1
- 230000004941 influx Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 206010025482 malaise Diseases 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000820 nonprescription drug Substances 0.000 description 1
- 244000052769 pathogen Species 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 230000005180 public health Effects 0.000 description 1
- 230000002685 pulmonary effect Effects 0.000 description 1
- 206010037844 rash Diseases 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 208000024891 symptom Diseases 0.000 description 1
- 239000003440 toxic substance Substances 0.000 description 1
- 239000003053 toxin Substances 0.000 description 1
- 231100000765 toxin Toxicity 0.000 description 1
- 108700012359 toxins Proteins 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Definitions
- This invention relates to a rapid syndrome analysis apparatus and method.
- the invention relates, in a computer, to a computer readable medium for providing rapid syndrome analysis including instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data in response to an observed value. Further, instructions are providing for comparing the CUSUM data with a predetermined plurality of threshold values. Finally, instructions are provided for generating a signal when the CUSUM data exceeds any of the plurality of threshold values by a predetermined amount.
- FIR CUSUM Fast Initial Response Cumulative Sum
- the standard FIR CUSUM test statistic calculates the deviations q from the moving mean (X bar ) on each day (t).
- the value S t (q) accumulates these deviations from the mean (q t ) but only if they exceeded the mean by a threshold value (k).
- a “signal” is generated, and the sum, S t , is reset to a starting value, S reset , for analyses continuing on succeeding days. All deviations (q t ), thresholds (k) and limits (h) are expressed in standardized units (sigmas).
- the user or programmer must specify an “interval width”, period of time for calculating the moving mean and standard deviation.
- the user must also specify the three model parameters (h, k, and S reset ) .
- the parameter values with the “best” sensitivity and specificity depend on the type, shape, amplitude and duration of the outbreak on wishes to detect. These characteristics of outbreaks are different for each disease and depend on the mode of exposure, the magnitude of exposure, the location of exposure, and numerous other variables that cannot be known in advance.
- the known FIR CUSUM procedure does not quantify the duration of a signal or flag. In fact, it “resets” after every out-of-control signal is generated, so consecutive days with unusual values are frequently missed.
- the FIR CUSUM method is not the only statistical method that exhibits these weaknesses when applied to real-world healthcare syndromes. Most of the available statistical methods that have been applied to outbreak detection were adapted from engineering and quality control applications, and have serious deficiencies in terms of sensitivity and specifically. Sensitivity is the proportion of true positives (true outbreaks detected). Specificity is the proportion of true negatives (false outbreaks not flagged). To maximize sensitivity and specificity, these algorithms require a long “training period” (a year or more of baseline data to “learn” what kinds of peaks comprise true positives and true negatives). This requirement for a large baseline set of data is often impractical because:
- the statistical methods proposed for outbreak detection are designed to detect only the beginning of a signal, and provide no subsequent information about the amplitude, shape or duration of the signal. Because these systems, including the FIR CUSUM, were developed for manufacturing and quality control settings, they assume that there is an easy way to confirm or identify the signal once it is detected. In disease surveillance, this assumption does not hold. There is rarely any easy way to confirm or identify the cause of any particular cluster, and the epidemiologist needs ongoing daily information about the amplitude, shape and duration of the outbreak to mount a proper investigation.
- the rapid syndrome analysis apparatus and method includes, in a computer, a computer readable medium with instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data in response to an observed value. Instructions are also provided for comparing the CUSUM data with a predetermined plurality of threshold values. Further, instructions for generating a signal are provided when the CUSUM data exceeds any of the plurality of threshold values by a predetermined amount.
- the computer readable medium includes instructions for ignoring CUSUM data which previously resulted in the generation of a signal.
- the computer readable medium includes instructions for measuring a plurality of CUSUMs simultaneously wherein the instructions include instructions for measuring data from a group of time blocks measured from a current date.
- the group of time blocks consists of seven days of data, fourteen days of data, twenty-one days of data and twenty-eight days of data measured from the current date.
- the instructions for measuring a plurality of CUSUMs simultaneously comprise instructions for measuring four separate CUSUMs for each of group of time blocks.
- the computer readable medium with instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data includes instructions for creating a moving baseline of CUSUM data with a declining weight given to older data.
- the instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data includes for ordering the CUSUM data for a current date such that days that are the same day of the week as the current date are given more weight.
- the instructions for comparing the CUSUM data with a predetermined plurality of threshold values includes instructions four separate threshold values increasing from lowest to highest.
- instructions for generating a signal include instructions for generating a “trimmed weighted” mean and sigma.
- the instructions for generating a trimmed weighted mean and sigma include instructions for excluding certain zero values.
- the invention includes instructions for calculating the duration of an event identified by one or more signals.
- instructions are provided for estimating the number of people ill with regard to an event identified by one or more signals.
- instructions are provided for generating data on the amplitude shape and duration of an event identified by a signal.
- a computer readable medium for providing rapid syndrome analysis includes instructions for measuring a plurality of CUSUMs simultaneously and generating SUSUM data with a moving baseline over a set period in response to an observed value. Instructions are also provided for comparing the CUSUM data with a predetermined plurality of threshold values. Further, instructions are provided for generating a signal when the CUSUM data exceeds any of the plurality of threshold values by a predetermined amount and, instructions are provided for generating a trimmed mean and sigma such that CUSUM data which previously resulted in the generation of a signal is excluded.
- the instructions for measuring the plurality of CUSUMs simultaneously include instructions for measuring data from a group of time blocks measured from a current date wherein the group of time blocks consists of seven days of data, fourteen days of data, twenty-one days of data and twenty-eight days of data measured from the current date.
- the instructions for generating a trimmed mean and sigma include instructions for excluding certain zero values.
- a method for providing rapid syndrome analysis includes the steps of measuring a plurality of CUSUMs simultaneously and generating CUSUM data with a moving baseline over a set period in response to an observed value. Next the CUSUM data is compared with a predetermined plurality of threshold values and a signal is generated when the CUSUM data exceeds any of the plurality of threshold values by predetermined amount. Finally, a trimmed weighted mean and sigma are generated such that CUSUM data which previously resulted in the generation of a signal is excluded.
- the step of measuring a plurality of CUSUMs simultaneously includes the step of measuring data from a group of time blocks measured from the current data wherein the group of time blocks consists of seven days of data, fourteen days of data, twenty-one days of data and twenty-eight days of data measured from the current date.
- the step of generating a trimmed mean and sigma includes the step of excluding certain zero values.
- the instructions for generating flags include instructions for flagging consecutive days so that ongoing outbreaks continue to generate daily flags until the number of observed cases begins to decline.
- FIG. 1 is a schematic of the rapid syndrome analysis apparatus of the present invention in use with a computer;
- FIG. 2 is an illustration of the sixteen separate CUSUMs measured in accordance with a preferred embodiment of the present invention
- FIG. 3 is a graph illustrating the unique analysis capabilities of the present invention.
- FIG. 4 is a graph of a compilation of four Prior Art CUSUMs limited to 30 day periods and single sets of parameters.
- FIG. 5 is a table of example calculations for four days illustrating the function of the analysis apparatus and method of the present invention.
- FIGS. 1-3 and 5 The preferred embodiment of the present invention is illustrated by way of example in FIGS. 1-3 and 5 .
- the rapid syndrome analysis apparatus and method 10 of the present invention is used with a computer 12 .
- Computer 12 includes monitor 14 , keyboard 16 , mouse 18 and connections therefore all as known in the art.
- Computer 12 may be any computer now known or hereafter developed for manipulating data.
- Computer 12 includes software 20 , as known, on computer readable medium 22 .
- Computer readable medium 22 includes software 20 on any medium such as a disc, cd, dvd or the like.
- the software 20 includes instructions for manipulation of data as will be more fully discussed hereafter.
- FIG. 1 shows computer 12 connected to network 24 .
- Network 24 may be an intranet, internet or any other network now known or hereafter developed.
- computer 12 may be connected to any number of other computer devices 26 .
- Computer devices 26 may be PCs, PDAs, cell phones or any other computing device now known or hereafter developed.
- Computer devices 26 may send observed data to computer 12 or receive data from computer 12 or both. For example only and not by way of limitation, multiple computer devices 26 may input observed data to computer 12 which then applies software 20 to the data.
- Computer 12 then sends the manipulated data, as will be discussed more fully hereafter, to other computer devices 26 operated, for example only, by medical doctors, the CDC, emergency centers and the like.
- a preferred embodiment of the rapid syndrome analysis apparatus and method 10 includes the simultaneous analysis of multiple parameters.
- FIG. 2 shows that the preferred embodiment analyzes sixteen different CUSUMs comprised of interval 30 , H 32 , K 34 and reset value 36 .
- Applicant has selected a group of time blocks as intervals 30 .
- the first row 38 is the first of four parameters for the seven day interval 30 .
- the value of H 32 is “3.0”.
- the H 32 value is the user's selected preset limit above which a signal 40 is generated.
- H 32 is three times the threshold value K 34 .
- the threshold value for K 34 is 1.75.
- the signal 40 in such a case is a “Blue” flag 42 .
- the reset value is one-half of H 32 , which, in row 38 , is “1.5”, all as will be discussed more fully hereafter.
- Row 44 is the second set of parameters for the seven day interval 30 .
- H 32 is “4.0”
- K 34 is “2.50”
- the reset value 36 is “2.0”. Should observed values result in a number equal to or greater than four times K 34 in row 44 , a signal 40 is generated. In this case the signal 40 is a Yellow flag 46 .
- Rows 48 and 50 are the third and fourth set of parameters for the seven day interval 30 .
- An orange flag 52 and a Red flag 54 is generated when the observed data results in a number the same or greater than the H 32 values on those rows.
- Applicant's invention provides for the simultaneous measurement of multiple CUSUMs. These multiple CUSUMs are compared to a plurality of threshold values. This is an important aspect of the invention in that it enables the user to identify outbreaks of a wide variety of unknown types quickly and repeatedly as will be discussed more fully hereafter.
- sixteen separate CUSUMs are provided based on four separate blocks of time and four separate measurements each.
- the blocks of times are multiple of seven days covering one, two, three, and four weeks as illustrated.
- S(t ⁇ 1) is the CUSUM from the day before the current day
- X the observed value for the current day (t).
- Mean weighted weighted average of included interval values
- K threshold as adjusted as set forth in FIG. 2 for signal 40 color and Interval 30 .
- CCSUM data includes all the elements, terms and results of these formulas as utilized by the invention set forth herein.
- Applicant's rapid syndrome analysis apparatus uses intervals 30 that are multiples of seven days and according to a further embodiment, it weighs each day in a moving baseline window differently in order to minimize the effects of weekly periodicity.
- Applicant's invention uses no ‘guard band,’ which means the baseline interval begins with the day immediately prior to the “Test Date”. Each day in this interval is given a linearly declining weight in the following order: Days that are the same day of the week as the “Test Date” are weighted most heavily, followed by all remaining values (most recent to least recent).
- a “trimmed weighted” mean and standard deviation are calculated to remove the influence of outliers on these statistics as follows:
- V Integer ( X t-1 /X t )
- Applicant's invention enables users to determine the duration of an outbreak which is another important and non-obvious improvement of the Applicant's invention over the prior art.
- the duration of the current outbreak is estimated to help the user appreciate its significance.
- the “duration” is calculated in accordance with Applicant's invention as:
- the “unusualness” or “seriousness” of the outbreak is also easily capable of determination.
- Number ill estimated (0.5) ( X bar-max ) (Sigma max ) ( f w ) (duration)
- FIG. 3 a graphic illustration of the power and sensitivity of Applicant's invention is provided.
- This example begins with a stable baseline (the moving trimmed weighted mean remains between 4.5 and 5.0) for 31 days in March. Beginning on April 1 and continuing to April 11, there is a very subtle outbreak as the baseline rises to 6.5. Notice how robust Applicant's invention is despite “dropped” or missing data. That is, even though March contains 3 days with zero cases, the trimmed moving weighted means remain very stable. Nonetheless, the rapid syndrome analysis apparatus and method 10 of the present invention is still able to detect the onset of this early April outbreak and the fact that it is continuing, even though there is zero value on April 4 right in the middle of the outbreak.
- FIG. 5 an example of the operation of the process of the invention is set forth in table form. It is understood that only a four day period, March 31 to April 3, and one interval 30 , the seven day interval, is detailed. Nonetheless the operation of the process will be easily understood to apply to multiple intervals as set forth in the invention.
- the table includes the following columns: Flag 56 , color 58 , interval 30 , observed date 60 , observed value 62 , weighted moving average 64 , weighted moving sigma 66 , S(t ⁇ 1) 68 , Q 70 , K 34 , Adjust 72 , H 32 and FIR CUSUM reset value 36 .
- Flag 56 the color of 58 .
- interval 30 the interval between the rows.
- observed date 60 the time 62
- weighted moving average 64 weighted moving average
- weighted moving sigma 66 weighted moving sigma 66
- S(t ⁇ 1) 68 , Q 70 , K 34 , Adjust 72 , H 32
- FIR CUSUM reset value 36 The operation of the formulas for determining these separate elements is as set forth above.
- An observed value 62 of 7 raises the blue color 58 , for example, to a CUSUM S(t) of 2.8520 which is not greater than the H 32 value of 3 but it is a positive number that becomes the new S(t ⁇ 1) 68 for the next day April 2.
- the CUSUM S(t) 74 is the result of the addition of the previous day's CUSUM or reset value S(t ⁇ 1) 68 plus Q 70 plus K 34 plus adjust 72 .
- Adjust 72 in the Table in FIG. 5 is a positive and when added to the K 34 in the table results in a K 34 in the table set out in FIG. 2 .
- Applicant has arranged the table in FIG. 5 so that it is possible simply to add from left to right and determine CUSUM S(t) 74 logically. Thereafter it is possible to visually make the comparison with H 32 . Because the CUSUM S(t) 74 on April 2 is more than color blue 58 three H 32 , the blue flag 56 is raised and the reset value 36 is one-half of H 32 or 1.5.
- Applicant's invention detects an obvious outbreak above and beyond the baseline that is higher than at the beginning of the month.
- Applicant's invention detects a one-day outbreak that occurs during the tail of the previous outbreak. These are very difficult to detect by any method other than the present invention because moving means by definition lag several to many days behind the day being tested. Therefore, with previous detection algorithms, the large mean and sigma from the preceding outbreak typically will mask any outbreak occurring in the 7-14 days following its peak. See for example the same data as analyzed by Prior Art systems shown in FIG. 4 . No flag of any kind is indicated for June 1.
- Applicant's sixteen different CUSUMs allow users to identify disease outbreaks whether they have a very short incubation period (a few hours, like many toxic chemicals) a short incubation period (a few days, like many gastrointestinal diseases), an intermediate incubation period (7-14 days, like smallpox), or a long incubation period (21-28 days, like hepatitis). They also allow provide a way for the same system to detect 1 or 2-day outbreaks (like the typical food borne outbreak) as well as 1 or 2-month outbreaks (like typical influenza outbreak every year).
- the rapid syndrome analysis apparatus and method 10 is not limited to detecting certain specific diseases. In fact, Applicant currently monitors the eleven different syndromes listed below. Note that two of these (neuro-toxic and radiation sickness) are not related to infectious diseases, but rather to chemical toxins or radiation threats.
- Applicant's invention is of practical importance because there is a need for a mathematical technique, for example only, to identify disease outbreaks in daily healthcare surveillance data.
- the types of data that could be analyzed using this algorithm include daily counts of:
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Development Economics (AREA)
- Tourism & Hospitality (AREA)
- Educational Administration (AREA)
- General Business, Economics & Management (AREA)
- Software Systems (AREA)
- Computational Mathematics (AREA)
- Algebra (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Analysis (AREA)
- Databases & Information Systems (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Optimization (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
- This application is a divisional of U.S. application Ser. No. 11/089,660, filed on Mar. 24, 2005, the disclosure of which is incorporated herein by reference.
- This invention relates to a rapid syndrome analysis apparatus and method. In particular, according to one embodiment, the invention relates, in a computer, to a computer readable medium for providing rapid syndrome analysis including instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data in response to an observed value. Further, instructions are providing for comparing the CUSUM data with a predetermined plurality of threshold values. Finally, instructions are provided for generating a signal when the CUSUM data exceeds any of the plurality of threshold values by a predetermined amount.
- Mathematical algorithms have been used to identify disease clusters and are a key component of syndromic surveillance software used to monitor for bioterrorism, as well as naturally occurring disease outbreaks. Examples of such algorithms are wide spread. One study of the use of algorithms of which Applicant is aware was made by DARPA. (See e.g. DARPA Bio-ALIRT Program Technical Report, “Evaluation of Algorithms for Outbreak Detection Using Clinical Data from Five U.S. Cities” (Oct. 15, 2004).
- With particular relevance to this invention, a statistical method for quality improvement in industry is known as the “Fast Initial Response Cumulative Sum” (FIR CUSUM) method. This method is well known and is explained in detail, for example, in Ryan, T. P., “Statistical Methods for Quality improvement” John Wiley & Sons, New York (1989) pp. 110-112.
- The standard FIR CUSUM test statistic calculates the deviations q from the moving mean (Xbar) on each day (t). The value St (q) accumulates these deviations from the mean (qt) but only if they exceeded the mean by a threshold value (k). When the accumulated sum of deviations exceed a preset limit h, a “signal” is generated, and the sum, St, is reset to a starting value, Sreset, for analyses continuing on succeeding days. All deviations (qt), thresholds (k) and limits (h) are expressed in standardized units (sigmas).
-
So=0 -
S t(q)=Max[0,S t-1 +q t −k] -
h=threshold value -
If S t(q)>h then reset to S t (q)=S reset -
(xt −x bar) -
where qt=______ (std. deviation) - Attempts have been made to apply the standard FIR CUSUM procedure to the problem of detecting and rapidly identifying the onset and outbreak of diseases. Nonetheless, there are many limitations of this standard FIR CUSUM procedure when applied to syndromatic surveillance data. By way of example only and not by limitation, some weaknesses of the FIR CUSUM are listed as follows:
- 1) the user or programmer must specify an “interval width”, period of time for calculating the moving mean and standard deviation. The user must also specify the three model parameters (h, k, and Sreset) . However, the parameter values with the “best” sensitivity and specificity depend on the type, shape, amplitude and duration of the outbreak on wishes to detect. These characteristics of outbreaks are different for each disease and depend on the mode of exposure, the magnitude of exposure, the location of exposure, and numerous other variables that cannot be known in advance.
- 2) The known FIR CUSUM procedure weights all data in the moving average window equally, making no allowance for the natural weekly periodicity seen in many healthcare settings.
- 3) The mean & standard deviation of the known FIR CUSUM procedure are heavily influenced by outliers, including zero values (in practice, zeros frequently represent missing data).
- 4) The known FIR CUSUM procedure can not quantify the “unusualness” or public health importance of a signal or flag. An outbreak involving 10 persons ill generates the same signal as one involving 200 people.
- 5) The known FIR CUSUM procedure does not quantify the duration of a signal or flag. In fact, it “resets” after every out-of-control signal is generated, so consecutive days with unusual values are frequently missed.
- The FIR CUSUM method is not the only statistical method that exhibits these weaknesses when applied to real-world healthcare syndromes. Most of the available statistical methods that have been applied to outbreak detection were adapted from engineering and quality control applications, and have serious deficiencies in terms of sensitivity and specifically. Sensitivity is the proportion of true positives (true outbreaks detected). Specificity is the proportion of true negatives (false outbreaks not flagged). To maximize sensitivity and specificity, these algorithms require a long “training period” (a year or more of baseline data to “learn” what kinds of peaks comprise true positives and true negatives). This requirement for a large baseline set of data is often impractical because:
- 1) Systems to collect syndromic surveillance data are only now being developed.
- 2) There are many situations where it is impossible to obtain comparable data. For example, the Olympic Games cause a large influx of people into a small geographic area for a limited period of time, so no comparable “baseline data” exist.
- 3) These algorithms are tuned to detect outbreaks similar to those that have occurred in the past. Bioterrorism attacks may produce outbreaks unlike any we have seen in the past.
- Also, the statistical methods proposed for outbreak detection are designed to detect only the beginning of a signal, and provide no subsequent information about the amplitude, shape or duration of the signal. Because these systems, including the FIR CUSUM, were developed for manufacturing and quality control settings, they assume that there is an easy way to confirm or identify the signal once it is detected. In disease surveillance, this assumption does not hold. There is rarely any easy way to confirm or identify the cause of any particular cluster, and the epidemiologist needs ongoing daily information about the amplitude, shape and duration of the outbreak to mount a proper investigation.
- Thus, there is a need in the art for an apparatus and method for rapidly analyzing health related data that does not require a long “training period”, that signals the outbreak of an illness quickly and that provides the user detailed information about the amplitude, shape and duration of the outbreak. It therefore is an object of the invention to provide an apparatus and method for providing rapid syndrome analysis that is easy to use and interpret and that is flexible and scalable.
- Accordingly, the rapid syndrome analysis apparatus and method, according to one aspect of the invention, includes, in a computer, a computer readable medium with instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data in response to an observed value. Instructions are also provided for comparing the CUSUM data with a predetermined plurality of threshold values. Further, instructions for generating a signal are provided when the CUSUM data exceeds any of the plurality of threshold values by a predetermined amount.
- According to a further aspect of the invention, the computer readable medium includes instructions for ignoring CUSUM data which previously resulted in the generation of a signal. In a further aspect, the computer readable medium includes instructions for measuring a plurality of CUSUMs simultaneously wherein the instructions include instructions for measuring data from a group of time blocks measured from a current date. According to another aspect of this embodiment, the group of time blocks consists of seven days of data, fourteen days of data, twenty-one days of data and twenty-eight days of data measured from the current date. According to a further aspect of this invention, the instructions for measuring a plurality of CUSUMs simultaneously comprise instructions for measuring four separate CUSUMs for each of group of time blocks.
- According to a further aspect of the invention, the computer readable medium with instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data includes instructions for creating a moving baseline of CUSUM data with a declining weight given to older data. In accordance with another aspect, the instructions for measuring a plurality of CUSUMs simultaneously and generating CUSUM data includes for ordering the CUSUM data for a current date such that days that are the same day of the week as the current date are given more weight. In another aspect of the invention, the instructions for comparing the CUSUM data with a predetermined plurality of threshold values includes instructions four separate threshold values increasing from lowest to highest.
- According to a further aspect of the invention, instructions for generating a signal include instructions for generating a “trimmed weighted” mean and sigma. According to a further aspect, the instructions for generating a trimmed weighted mean and sigma include instructions for excluding certain zero values. According to another aspect, the invention includes instructions for calculating the duration of an event identified by one or more signals. According to a further aspect, instructions are provided for estimating the number of people ill with regard to an event identified by one or more signals. According to a further aspect of the invention, instructions are provided for generating data on the amplitude shape and duration of an event identified by a signal.
- In another embodiment of the invention, in a computer, a computer readable medium for providing rapid syndrome analysis includes instructions for measuring a plurality of CUSUMs simultaneously and generating SUSUM data with a moving baseline over a set period in response to an observed value. Instructions are also provided for comparing the CUSUM data with a predetermined plurality of threshold values. Further, instructions are provided for generating a signal when the CUSUM data exceeds any of the plurality of threshold values by a predetermined amount and, instructions are provided for generating a trimmed mean and sigma such that CUSUM data which previously resulted in the generation of a signal is excluded.
- In another aspect of the invention, the instructions for measuring the plurality of CUSUMs simultaneously include instructions for measuring data from a group of time blocks measured from a current date wherein the group of time blocks consists of seven days of data, fourteen days of data, twenty-one days of data and twenty-eight days of data measured from the current date. In another aspect of the invention, the instructions for generating a trimmed mean and sigma include instructions for excluding certain zero values.
- In another embodiment of the invention, a method for providing rapid syndrome analysis includes the steps of measuring a plurality of CUSUMs simultaneously and generating CUSUM data with a moving baseline over a set period in response to an observed value. Next the CUSUM data is compared with a predetermined plurality of threshold values and a signal is generated when the CUSUM data exceeds any of the plurality of threshold values by predetermined amount. Finally, a trimmed weighted mean and sigma are generated such that CUSUM data which previously resulted in the generation of a signal is excluded.
- In another aspect of this invention, the step of measuring a plurality of CUSUMs simultaneously includes the step of measuring data from a group of time blocks measured from the current data wherein the group of time blocks consists of seven days of data, fourteen days of data, twenty-one days of data and twenty-eight days of data measured from the current date. In another aspect of the invention, the step of generating a trimmed mean and sigma includes the step of excluding certain zero values.
- In another aspect of the invention, the instructions for generating flags include instructions for flagging consecutive days so that ongoing outbreaks continue to generate daily flags until the number of observed cases begins to decline.
- Other objects, features and advantages of the present invention will become more fully apparent from the following detailed description of the preferred embodiments and the accompanying drawings in which:
-
FIG. 1 is a schematic of the rapid syndrome analysis apparatus of the present invention in use with a computer; -
FIG. 2 is an illustration of the sixteen separate CUSUMs measured in accordance with a preferred embodiment of the present invention; -
FIG. 3 is a graph illustrating the unique analysis capabilities of the present invention; -
FIG. 4 is a graph of a compilation of four Prior Art CUSUMs limited to 30 day periods and single sets of parameters; and -
FIG. 5 is a table of example calculations for four days illustrating the function of the analysis apparatus and method of the present invention. - The preferred embodiment of the present invention is illustrated by way of example in
FIGS. 1-3 and 5. With specific reference toFIG. 1 , the rapid syndrome analysis apparatus andmethod 10 of the present invention, according to one embodiment, is used with acomputer 12.Computer 12 includesmonitor 14,keyboard 16,mouse 18 and connections therefore all as known in the art.Computer 12 may be any computer now known or hereafter developed for manipulating data.Computer 12 includessoftware 20, as known, on computerreadable medium 22. Computerreadable medium 22 includessoftware 20 on any medium such as a disc, cd, dvd or the like. Thesoftware 20 includes instructions for manipulation of data as will be more fully discussed hereafter. -
FIG. 1 , showscomputer 12 connected to network 24.Network 24 may be an intranet, internet or any other network now known or hereafter developed. By means ofnetwork 24,computer 12 may be connected to any number ofother computer devices 26.Computer devices 26 may be PCs, PDAs, cell phones or any other computing device now known or hereafter developed.Computer devices 26 may send observed data tocomputer 12 or receive data fromcomputer 12 or both. For example only and not by way of limitation,multiple computer devices 26 may input observed data tocomputer 12 which then appliessoftware 20 to the data.Computer 12 then sends the manipulated data, as will be discussed more fully hereafter, toother computer devices 26 operated, for example only, by medical doctors, the CDC, emergency centers and the like. - Referring now to
FIG. 2 , a preferred embodiment of the rapid syndrome analysis apparatus andmethod 10 includes the simultaneous analysis of multiple parameters.FIG. 2 shows that the preferred embodiment analyzes sixteen different CUSUMs comprised ofinterval 30,H 32,K 34 and resetvalue 36. Instead of asingle interval 30 as known in the prior art, Applicant has selected a group of time blocks asintervals 30. According to one aspect of the invention, there are four time blocks of seven, fourteen, twenty-one, and twenty-eight day intervals. - Further there are four different values of
H 32,K 34 and resetvalue 36 for each of the fourtime block intervals 30. Referring toFIG. 2 , thefirst row 38 is the first of four parameters for the sevenday interval 30. Inrow 38, the value ofH 32 is “3.0”. TheH 32 value is the user's selected preset limit above which asignal 40 is generated. Here,H 32 is three times thethreshold value K 34. Inrow 38, the threshold value forK 34 is 1.75. As will be discussed more fully hereafter, when observed data results in a value ofH 32 of threetimes K 34, asignal 40 is generated. According to one embodiment, thesignal 40 in such a case is a “Blue”flag 42. In such a case, the reset value is one-half ofH 32, which, inrow 38, is “1.5”, all as will be discussed more fully hereafter. -
Row 44 is the second set of parameters for the sevenday interval 30. Here,H 32 is “4.0”,K 34 is “2.50” and thereset value 36 is “2.0”. Should observed values result in a number equal to or greater than fourtimes K 34 inrow 44, asignal 40 is generated. In this case thesignal 40 is aYellow flag 46. -
Rows day interval 30. Anorange flag 52 and aRed flag 54 is generated when the observed data results in a number the same or greater than theH 32 values on those rows. - As can be appreciated, Applicant's invention, according to one embodiment, provides for the simultaneous measurement of multiple CUSUMs. These multiple CUSUMs are compared to a plurality of threshold values. This is an important aspect of the invention in that it enables the user to identify outbreaks of a wide variety of unknown types quickly and repeatedly as will be discussed more fully hereafter.
- In another embodiment, as can be seen from
FIG. 2 , sixteen separate CUSUMs are provided based on four separate blocks of time and four separate measurements each. According to a preferred embodiment, the blocks of times are multiple of seven days covering one, two, three, and four weeks as illustrated. - The formula for the cumulative sums (CUSUMs) according to the present invention is:
-
S(t)=S(t−1)+Q(t)+(K) - where
- S(t) is the CUSUM of the current day and
- S(t−1) is the CUSUM from the day before the current day;
-
Q(t)=(X−meanweighted)/Sigmaweighted), - where
- X=the observed value for the current day (t).
- Meanweighted=weighted average of included interval values
- Sigmaweighted−weighted standard deviation of included interval values;
- K=threshold as adjusted as set forth in
FIG. 2 forsignal 40 color andInterval 30. - When S(t) is greater than
H 32, theappropriate signal 40 color flag is generated and thereset value 36 is used as S(t−1). For an S(t) that is negative, thereset value 36 is zero. - As used herein, the term “CUSUM data” includes all the elements, terms and results of these formulas as utilized by the invention set forth herein.
- Applicant's rapid syndrome analysis apparatus, according to one embodiment, uses
intervals 30 that are multiples of seven days and according to a further embodiment, it weighs each day in a moving baseline window differently in order to minimize the effects of weekly periodicity. Applicant's invention uses no ‘guard band,’ which means the baseline interval begins with the day immediately prior to the “Test Date”. Each day in this interval is given a linearly declining weight in the following order: Days that are the same day of the week as the “Test Date” are weighted most heavily, followed by all remaining values (most recent to least recent). For example, if the test date is Monday, then a fourteenday interval 30 moving average is calculated using the weights Last Monday=14, 2-weeks-ago Monday=13, Yesterday (Sunday)=12, Day Before Yesterday (Saturday)=11, Last Friday=10, Last Thursday=9, Last Wednesday=8, Last Tuesday=7, 2-week ago Sunday=6, 2-weeks-ago Saturday=5, 2-weeks-ago Friday=4, 2-weeks-ago Thursday=3, 2-weeks-ago Wednesday=2, 2-weeks-ago Tuesday=1. - Further, according to one embodiment, a “trimmed weighted” mean and standard deviation are calculated to remove the influence of outliers on these statistics as follows:
- a. Extreme values are excluded. “Extreme” is defined as the highest and lowest (100/Interval) percent of values. For a seven
day interval 30, this is the highest and lowest 14% of values. For a twenty-eightday interval 30, this is the highest and lowest 3.5% of values; and/or
b. Only non-flagged days prior to the current date are included. That is, theBaseline interval 30 is extended back from the “Test Date” until it includes the required seven, fourteen, twenty-one, or twenty-eight non-flagged values.
c. Zero values are excluded from the calculations of the mean but they are included in the standard deviation unless the value zero is within 4 sigmas of the last calculated moving weighted mean. This is a very important and non-obvious improvement of the Applicant's invention over the prior art. - Still further, once a signal (flag) 40 is generated, consecutive daily values of equal or higher value continue to generate
daily flags 40. Daily signals 40 continue to be generated as long as daily values stay above the mean. This is because, regardless of the value of any CUSUM, if a daily value is greater than the moving mean, then flags are only allowed to decline by a certain value (V) each day. V is calculated by the following formula: -
V=Integer (X t-1 /X t) - where Xt=today's observed value, and
- Xt-1=yesterday's observed value
- As a result, Applicant's invention enables users to determine the duration of an outbreak which is another important and non-obvious improvement of the Applicant's invention over the prior art. The duration of the current outbreak is estimated to help the user appreciate its significance. The “duration” is calculated in accordance with Applicant's invention as:
- duration=# of consecutive non-zero flagged days.
- In accordance with Applicant's invention the “unusualness” or “seriousness” of the outbreak is also easily capable of determination. The “unusualness” of a signal is identified by color coding. In order of increasing “unusualness”, flags have increasing weights (fblue)=1, (fyellow)=2, (forange)=3, and (fred)=4.
- Still further, for count data, it is also possible with Applicant's invention to estimate the number of people ill in the current outbreak so as to further help the user appreciate its significance. The “number ill” is calculated in accordance with Applicant's invention as follows:
-
Number illestimated=(0.5) (X bar-max) (Sigmamax) (f w) (duration) - where Xbar-max=weighted mean of interval producing a highest flag
- sigmamax=weighted standard deviation of interval producing the highest flag
- fw=weight of highest flag
- Referring now to
FIG. 3 , a graphic illustration of the power and sensitivity of Applicant's invention is provided. This example begins with a stable baseline (the moving trimmed weighted mean remains between 4.5 and 5.0) for 31 days in March. Beginning on April 1 and continuing to April 11, there is a very subtle outbreak as the baseline rises to 6.5. Notice how robust Applicant's invention is despite “dropped” or missing data. That is, even though March contains 3 days with zero cases, the trimmed moving weighted means remain very stable. Nonetheless, the rapid syndrome analysis apparatus andmethod 10 of the present invention is still able to detect the onset of this early April outbreak and the fact that it is continuing, even though there is zero value on April 4 right in the middle of the outbreak. - Referring now to
FIG. 5 , an example of the operation of the process of the invention is set forth in table form. It is understood that only a four day period, March 31 to April 3, and oneinterval 30, the seven day interval, is detailed. Nonetheless the operation of the process will be easily understood to apply to multiple intervals as set forth in the invention. - The table includes the following columns:
Flag 56,color 58,interval 30, observeddate 60, observedvalue 62, weighted movingaverage 64, weighted movingsigma 66, S(t−1) 68,Q 70,K 34, Adjust 72,H 32 and FIRCUSUM reset value 36. The operation of the formulas for determining these separate elements is as set forth above. - Referring to
FIG. 5 specifically, it can be seen that an observedvalue 62 to 5 on March 31 results in a CUSUM S(t) 74 of a negative value for all four of thesignal 40 calculations. In accordance with the invention, whenever the CUSUM S(t) 74 is less than zero, negative, thereset value 36 is zero and noflag 56 is raised for anycolor 58 for that sevenday interval 30. - An observed
value 62 of 7 raises theblue color 58, for example, to a CUSUM S(t) of 2.8520 which is not greater than theH 32 value of 3 but it is a positive number that becomes the new S(t−1)68 for the next day April 2. - Even though the observed
value 62 decreases to 6 on April 2, it is sufficient in accordance with Applicant's invention, however, to result in a CUSUM S(t) 74 of 3.7315 which is greater than the blue color requirement of 3 forH 32. Thus acolor 58blue flag 56 is shown in the table. - By way of further explanation, the CUSUM S(t) 74 is the result of the addition of the previous day's CUSUM or reset value S(t−1) 68
plus Q 70plus K 34 plus adjust 72. Adjust 72 in the Table inFIG. 5 is a positive and when added to theK 34 in the table results in aK 34 in the table set out inFIG. 2 . Applicant has arranged the table inFIG. 5 so that it is possible simply to add from left to right and determine CUSUM S(t) 74 logically. Thereafter it is possible to visually make the comparison withH 32. Because the CUSUM S(t) 74 on April 2 is more than color blue 58 threeH 32, theblue flag 56 is raised and thereset value 36 is one-half ofH 32 or 1.5. - Continuing with the explanation, an observed
value 62 on April 3 of 7, now results in both a blue andyellow color 58 flag. - Referring to
FIG. 3 , in accordance with Applicant's invention, only thehighest flag 56 is shown for any one day, which in this case is ayellow flag 46. - Continuing now with reference to
FIG. 3 , on April 12-13 Applicant's invention detects an obvious outbreak above and beyond the baseline that is higher than at the beginning of the month. - April 22-24 Applicant's invention detects another subtle outbreak, with 9 and 10 cases per day, and on April 28-May 1 there is a 2nd outbreak superimposed on this outbreak. Importantly, the present invention detects the second outbreak because it discards flagged values from the calculation of trimmed moving weighted means and sigmas, and marks the second outbreak with an Orange flag.
- A huge outbreak occurs from May 11-May 28, which shows that the invention continues to flag every day of an ongoing outbreak (unlike the regular prior art CUSUM which only flags the onset, and then resets to 0). Note also that even though there is a “dropped” or missing data point in the middle of this huge outbreak (May 19), the apparatus and
method 10 of the present invention quickly recognizes that this outbreak has not ended—giving a red flag 3 days later on May 22. - On June 1 Applicant's invention detects a one-day outbreak that occurs during the tail of the previous outbreak. These are very difficult to detect by any method other than the present invention because moving means by definition lag several to many days behind the day being tested. Therefore, with previous detection algorithms, the large mean and sigma from the preceding outbreak typically will mask any outbreak occurring in the 7-14 days following its peak. See for example the same data as analyzed by Prior Art systems shown in
FIG. 4 . No flag of any kind is indicated for June 1. - In June and July, it is apparent that the baseline (or background level) of cases has risen and the trimmed moving weighted mean varies between 7.5 and 8.0 cases per day. The present invention adjusts for this increased baseline and does not flag outbreaks at this level. Note that this level is higher than the outbreak level (6.5) detected in early April and shows that the present invention is still sensitive to a changing baseline. Nonetheless, it does pick up the outbreak on June 22-27 it also recognizes 1-day outbreaks on July 3 and July 7.
- A large outbreak occurs from July 10-15 and is flagged with orange and red flags. Although its amplitude is not very high (13 cases on July 11), its duration is rather long (6 days), and it affects a large number of patients. This is why Applicant's invention generates a red flag.
- The last outbreak on July 25-26 has a higher amplitude but only lasts for 2 days, so it generates 2 blue flags. The examples in July show the importance of using trimmed weighted means and sigmas. The wild fluctuations in the number of cases per day, including 3 days with zeroes (missing data) would cause the untrimmed mean and sigma to be completely unreliable. See for example and comparison again, the Prior Art system shown
FIG. 4 for the same date and note that no signal is given, In fact, the Prior Art CUSUM-30 graph shown inFIG. 4 of these data show that only one of the regular 30-Day CUSUMs detects even a single outbreak in July. It should be noted that nowhere has Applicant even seen four separate CUSUMs overlayed in a single prior art system. They are presented this way inFIG. 4 simply to show that none of the prior art CUSUMs is any way near as accurate and sensitive as the present invention. According to the preferred embodiment, Applicant's sixteen different CUSUMs allow users to identify disease outbreaks whether they have a very short incubation period (a few hours, like many toxic chemicals) a short incubation period (a few days, like many gastrointestinal diseases), an intermediate incubation period (7-14 days, like smallpox), or a long incubation period (21-28 days, like hepatitis). They also allow provide a way for the same system to detect 1 or 2-day outbreaks (like the typical food borne outbreak) as well as 1 or 2-month outbreaks (like typical influenza outbreak every year). - Because it uses a plurality of CUSUMs, according to one embodiment, sixteen different combinations of H, K and reset values, the rapid syndrome analysis apparatus and
method 10 is not limited to detecting certain specific diseases. In fact, Applicant currently monitors the eleven different syndromes listed below. Note that two of these (neuro-toxic and radiation sickness) are not related to infectious diseases, but rather to chemical toxins or radiation threats. - 1) Flu-like syndrome
- 2) Pox-like Rash syndrome
- 3) Pulmonary syndrome
- 4) Gastrointestinal syndrome
- 5) Hepatitis-like syndrome
- 6) Neuro-Toxic syndrome
- 7) Encephalitis-like syndrome
- 8) Systemic-illness syndrome
- 9) Sepsis-DIC syndrome(DIC=disseminated intravascular coagulation)
- 10) Radiation Sickness syndrome
- 11) SARS-like syndrome
- Applicant's invention is of practical importance because there is a need for a mathematical technique, for example only, to identify disease outbreaks in daily healthcare surveillance data. The types of data that could be analyzed using this algorithm include daily counts of:
- 1) Symptoms of patients visiting hospital emergency departments
- 2) Over-the-counter medications purchased at pharmacies
- 3) Absences from school due to illness
- 4) Laboratory cultures of infectious pathogens
- 5) Cases of unusual or serious disease among humans reported to the health department
- 6) Cases of unusual or serious disease among animals reported to veterinarians
- Obviously, any desired observable data can be utilized as the “daily count” for the purpose of the invention. In that regard, the description of the present embodiments of the invention have been presented for the purposes of illustration but are not intended to be exhaustive or to limit the invention to the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. As such, while the present inventions has been disclosed in connection with the preferred embodiment thereof, it should be understood that there may be other embodiments which fall within the spirit and scope of the invention as defined by the following claims.
Claims (7)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/098,695 US20140095567A1 (en) | 2005-03-24 | 2013-12-06 | Rapid syndrome analysis apparatus and method |
US17/190,523 US11868424B2 (en) | 2005-03-24 | 2021-03-03 | Rapid syndrome analysis apparatus and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/089,660 US8660854B1 (en) | 2005-03-24 | 2005-03-24 | Rapid syndrome analysis apparatus and method |
US14/098,695 US20140095567A1 (en) | 2005-03-24 | 2013-12-06 | Rapid syndrome analysis apparatus and method |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/089,660 Division US8660854B1 (en) | 2005-03-24 | 2005-03-24 | Rapid syndrome analysis apparatus and method |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/190,523 Continuation US11868424B2 (en) | 2005-03-24 | 2021-03-03 | Rapid syndrome analysis apparatus and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140095567A1 true US20140095567A1 (en) | 2014-04-03 |
Family
ID=50126094
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/089,660 Active 2029-04-30 US8660854B1 (en) | 2005-03-24 | 2005-03-24 | Rapid syndrome analysis apparatus and method |
US14/098,695 Abandoned US20140095567A1 (en) | 2005-03-24 | 2013-12-06 | Rapid syndrome analysis apparatus and method |
US17/190,523 Active 2025-06-06 US11868424B2 (en) | 2005-03-24 | 2021-03-03 | Rapid syndrome analysis apparatus and method |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/089,660 Active 2029-04-30 US8660854B1 (en) | 2005-03-24 | 2005-03-24 | Rapid syndrome analysis apparatus and method |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/190,523 Active 2025-06-06 US11868424B2 (en) | 2005-03-24 | 2021-03-03 | Rapid syndrome analysis apparatus and method |
Country Status (1)
Country | Link |
---|---|
US (3) | US8660854B1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8660854B1 (en) * | 2005-03-24 | 2014-02-25 | Becton, Dickinson And Company | Rapid syndrome analysis apparatus and method |
US11243523B2 (en) * | 2019-12-23 | 2022-02-08 | Johnson Controls Tyco IP Holdings LLP | Building system with adaptive fault detection |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5651100A (en) * | 1990-06-28 | 1997-07-22 | Omron Corporation | Approximate reasoning apparatus |
US8660854B1 (en) * | 2005-03-24 | 2014-02-25 | Becton, Dickinson And Company | Rapid syndrome analysis apparatus and method |
-
2005
- 2005-03-24 US US11/089,660 patent/US8660854B1/en active Active
-
2013
- 2013-12-06 US US14/098,695 patent/US20140095567A1/en not_active Abandoned
-
2021
- 2021-03-03 US US17/190,523 patent/US11868424B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5651100A (en) * | 1990-06-28 | 1997-07-22 | Omron Corporation | Approximate reasoning apparatus |
US8660854B1 (en) * | 2005-03-24 | 2014-02-25 | Becton, Dickinson And Company | Rapid syndrome analysis apparatus and method |
Non-Patent Citations (1)
Title |
---|
Lewis, Disease outbreak detection system using syndromic data in the greater Washington DC area, Am J Prev Med. 2002 Oct;23(3):229-30 * |
Also Published As
Publication number | Publication date |
---|---|
US11868424B2 (en) | 2024-01-09 |
US8660854B1 (en) | 2014-02-25 |
US20210263990A1 (en) | 2021-08-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11868424B2 (en) | Rapid syndrome analysis apparatus and method | |
Reis et al. | Time series modeling for syndromic surveillance | |
US10332638B2 (en) | Methods and systems for pre-symptomatic detection of exposure to an agent | |
Kiamari et al. | COVID-19 Risk Estimation using a Time-varying SIR-model | |
Neill et al. | Fast subset scan for multivariate event detection | |
Li et al. | BaySTDetect: detecting unusual temporal patterns in small area data via Bayesian model choice | |
CN109166630B (en) | Infectious disease data monitoring and processing method and system | |
Steinmeyer et al. | Methods of modelling viral disease dynamics across the within-and between-host scales: the impact of virus dose on host population immunity | |
Stoto et al. | Evaluating statistical methods for syndromic surveillance | |
CN112650608B (en) | Abnormal root cause positioning method, related device and equipment | |
Manitz et al. | Bayesian outbreak detection algorithm for monitoring reported cases of campylobacteriosis in Germany | |
Madouasse et al. | Evaluation of a continuous indicator for syndromic surveillance through simulation. application to vector borne disease emergence detection in cattle using milk yield | |
Funk et al. | Early dynamics of transmission and control of 2019-nCoV: a mathematical modelling study | |
Iyaniwura et al. | Mathematical modeling of COVID-19 in British Columbia: an age-structured model with time-dependent contact rates | |
Wang et al. | Factors affecting automated syndromic surveillance | |
Mahmood et al. | Modeling infectious disease dynamics: Integrating contact tracing-based stochastic compartment and spatio-temporal risk models | |
Murphy et al. | Recombinant temporal aberration detection algorithms for enhanced biosurveillance | |
Fosdick et al. | Model-based evaluation of policy impacts and the continued COVID-19 risk at long term care facilities | |
Kuryliak et al. | Efficient and Realistic Stochastic Simulation of the Dynamics of Epidemic Processes on Complex Networks | |
Allévius et al. | An expectation-based space-time scan statistic for ZIP-distributed data | |
Engmann et al. | Multichart schemes for detecting changes in disease incidence | |
Pauler et al. | Non‐linear hierarchical models for monitoring compliance | |
Kuryliak et al. | Efficient stochastic simulation of network topology effects on the peak number of infections in epidemic outbreaks | |
Chen et al. | Spatiotemporal bayesian analysis of lyme disease in New York State, 1990-2000 | |
Jhuang et al. | Spatiotemporal signal detection using continuous shrinkage priors |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INFECTION CONTROL & PREVENTION ANALYSTS, INC., TEX Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GUSTAFSON, TRACY L.;REEL/FRAME:032441/0751 Effective date: 20050322 |
|
AS | Assignment |
Owner name: BECTON, DICKINSON AND COMPANY, NEW JERSEY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INFECTION CONTROL AND PREVENTION ANALYSTS, INC.;REEL/FRAME:034125/0540 Effective date: 20090630 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: NOTICE OF APPEAL FILED |
|
STCV | Information on status: appeal procedure |
Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER |
|
STCV | Information on status: appeal procedure |
Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER |
|
STCV | Information on status: appeal procedure |
Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS |
|
STCV | Information on status: appeal procedure |
Free format text: BOARD OF APPEALS DECISION RENDERED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION |