EP2000934A1 - A reputation system for providing a measure of reliability on health data - Google Patents

A reputation system for providing a measure of reliability on health data Download PDF

Info

Publication number
EP2000934A1
EP2000934A1 EP20070109798 EP07109798A EP2000934A1 EP 2000934 A1 EP2000934 A1 EP 2000934A1 EP 20070109798 EP20070109798 EP 20070109798 EP 07109798 A EP07109798 A EP 07109798A EP 2000934 A1 EP2000934 A1 EP 2000934A1
Authority
EP
Grant status
Application
Patent type
Prior art keywords
reputation
data
bp
health data
measure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP20070109798
Other languages
German (de)
French (fr)
Inventor
designation of the inventor has not yet been filed The
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce, e.g. shopping or e-commerce
    • G06Q30/02Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
    • G06Q30/0282Business establishment or product rating or recommendation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F19/00Digital computing or data processing equipment or methods, specially adapted for specific applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F19/00Digital computing or data processing equipment or methods, specially adapted for specific applications
    • G06F19/30Medical informatics, i.e. computer-based analysis or dissemination of patient or disease data
    • G06F19/32Medical data management, e.g. systems or protocols for archival or communication of medical images, computerised patient records or computerised general medical references
    • G06F19/324Management of patient independent data, e.g. medical references in digital format
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/22Social work
    • G06Q50/24Patient record management
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms

Abstract

This invention relates to a system and a method for providing a measure of reliability on a first set of health data (102) on a patient (103) provided by a data provider. An assigner (105) is used for assigning the first set of health data or the data provider with at least one first rating element. A reputation-indicator (106) uses the at least one first rating element as input data in determining a first reputation measure indicating the reliability of the data provider. A comparer (107) then compares the determined first reputation measure with a pre-defined reputation threshold measure, the reputation threshold measure being a measure of a pre-set reliability level of the data provider.

Description

    FIELD OF THE INVENTION
  • The present invention relates to a reputation system and a method for providing a measure of reliability on a first set of health data on a patient.
  • BACKGROUND OF THE INVENTION Electronic health records (EHR):
  • Nowadays, health data resides in the proprietary systems of healthcare providers. With the increased access to large networks, the possibility for a distributed system for health data arises, e.g. regional or national electronic health records (EHR) infrastructures. Healthcare professionals provide the information for these EHRs. The main objectives of EHRs are an increase of efficiency and quality of healthcare because of increased availability and reliability of health data. The Healthcare Information and Management Systems Society (HIMSS) provide a definition for an electronic health record ( T. Handler, R. Holtmeier, J. Metzger, M. Overhage, S. Taylor and C. Underwoord. HIMSS electronic health record definitional model version 1.1.2003 ). The Electronic Health Record (EHR) is a secure, real-time, point-of-care, patient centric information resource for clinicians. The EHR aids clinicians' decision making by providing access to patient health record information where and when they need it and by incorporating evidence-based decision support. The EHR automates and streamlines the clinician's workflow, closing loops in communication and response that result in delays or gaps in care. The EHR also supports the collection of data for uses other than direct clinical care, such as billing, quality management, outcomes reporting, resource planning, and public health disease surveillance and reporting. Currently, many countries are building and implementing electronic health records.
  • Personal health records (PHR):
  • A personal health record is a health record that is managed by the patient instead of the healthcare provider. Healthcare providers are not the only parties that can provide health data for the patient's well-being. Patients (but also people that are not ill, but are concerned about their health) may want to provide health information for their health records. Think for example of weight, heart rate and blood pressure information. Furthermore, as wellness providers such as fitness clubs and weight control clubs are professionalizing, they may want to use and provide relevant health data for the patient's health record. The health data supplied by the patient, wellness providers and healthcare providers is stored in the patient's PHR. Another reason for using a PHR is that healthcare providers are obliged to keep the patient records only for a certain period of time before they delete them. Patients that want to keep their health data after the data retention period can transfer them to their PHR. PHRs empower patients by providing them control over their health data. The patient may manage and share his health data in his PHR at his own discretion. After sharing, the health data in the PHR can be used by healthcare providers and wellness providers to improve the patient's health. Health data in a PHR is different from health data in an EHR. Health data in an EHR is always supplied (or at least reviewed) by a healthcare provider. Therefore, the health data that is in an EHR is considered accurate and trustworthy. In contrast, health data in a PHR can be supplied by healthcare providers, wellness providers and patients. Patients can supply their health data by adding the health data themselves, or by using a device that produces the health data and adds it to the PHR. Although the reliability of the health data supplied by patients and wellness providers cannot be guaranteed, this health data may be valuable for a healthcare provider. The health data supplied by the patient or by wellness providers can guide a healthcare provider in medical decision making, in making diagnoses, in deciding which medical tests and checks to do and in deciding whether to refer a patient to another healthcare provider. Considering the numerous PHR initiatives there is a trend in the USA that PHRs are more and more used (http://www.e-health-insider.com/news/item.cfm?ID=2520).
  • Parties and the reliability of their health data:
  • Healthcare providers are persons with a background in medicine, therefore health data originating from a healthcare provider can be expected to have a certain level of accuracy. Moreover, healthcare providers are certified as such, and are listed in national registers. Therefore, healthcare providers are expected to produce highly reliable health data for both EHRs and PHRs. Health data supplied by patients is of varying reliability because patients have varying medical knowledge. Chronically ill patients taking measurements every day are likely to provide very accurate health data. However, many patients do not exactly know how to take measurements. Elderly people may have difficulties taking measurements. In general, the reliability of patient-supplied health data may vary from useless to a level comparable to health data supplied by a healthcare provider. As with patient-supplied health data, health data supplied by wellness providers can also be of varying quality. Wellness providers that supply health data are often specialized in their field of expertise. Therefore, the reliability of the supplied health data is probably not very bad. The reliability of this health data depends on the quality of the devices, the level of training of the employees of the wellness provider and the level of training the wellness provider gives to their consumers.
  • Therefore, it is very difficult to evaluate the reliability of existing health data.
  • BRIEF DESCRIPTION OF THE INVENTION
  • The object of the present invention is to provide a system and a method for determining the reliability of health data on a patient.
  • According to one aspect the present invention relates to a reputation system for providing a measure of reliability on a first set of health data on a patient provided by a data provider, the system comprising:
  1. a) an assigner for assigning the first set of health data or the data provider with at least one first rating element,
  2. b) a reputation-indicator for using at least one first rating element as input data in determining a first reputation measure indicating the reliability of the data provider, and
  3. c) a comparer for comparing the determined first reputation measure with a pre-defined reputation threshold measure, the reputation threshold measure being a measure of a pre-set reliability level of the data provider.
  • Accordingly, by evaluating the data provider in this way, it is possible to evaluate the reliability of the health data. This gives e.g. healthcare providers the advantage of making an informed decision on the reliability of health data based on the reputation of the data provider with almost no overhead for healthcare providers, wellness providers and patients.
  • In one embodiment, the assigner comprises a rule engine adapted to determine ratings for the data provider associated with certificates of the data provider.
  • Therefore, a relevant parameter or a measure is provided about the data provider, namely if he/she is qualified or not in collecting health data.
  • In one embodiment, the assigner comprises an aggregation engine adapted to determine ratings for the health data based on comparing two or more health data sets on the same patient provided by different data providers.
  • Accordingly, if e.g. two data sets are very similar a good indicator is provided indicating that the data provider is reliable.
  • In one embodiment, the aggregation engine determines the ratings for the health data by calculating the consistency between two or more health data sets.
  • In one embodiment, the assigner comprises a healthcare provider or a wellness provider which assigns by a manual operation the health data with the at least one rating element.
  • Accordingly, a manual operation is also possible to assign the health data with one or more rating elements. As an example, the healthcare provider can e.g. be a doctor, dentists, surgeons or any kind of expert who is present when the patient creates the health data. After observing the patient, the healthcare provider can manually assign the data with a reliable rating element.
  • In one embodiment, the rating means comprises a metadata source for incorporating metadata to the health data, the metadata being implemented as additional data source in assigning the health data with at least one rating element.
    Accordingly, such metadata can e.g. include whether the patient was steady during the measurement, whether the measurement condition was correct, the type of the measurement device and thus the accuracy of the measurement device etc. All these additional information can be highly relevant when assigning the health data with one or more rating element.
  • In one embodiment, the data provider is a patient or a wellness provider. In another embodiment, the data provider is a healthcare provider.
  • In one embodiment, the first set of health data as well as the accompanying metadata is obtained from an external database or system over a communication channel.
  • In one embodiment, the first reputation measure related to health data is sent over a communication channel to a remote system.
  • In one embodiment, the rating relating to a first set of health data is sent over a communication channel to a remote system
  • According to another aspect, the present invention relates to a method of providing a measure of reliability on a first set of health data on a patient provided by a data provider, comprising:
    1. a) assigning the first set health data or the data provider with at least one rating element,
    2. b) using the assigned rating element as input data in determining a first reputation measure indicating the reliability of the data provider, and
    3. c) comparing the determined first reputation measure with a pre-defined reputation threshold measure, the reputation threshold measure being a measure of a pre-set reliability level of the data provider.
  • According to yet another aspect, the present invention relates to a computer program product for instructing a processing unit to execute the method step of the method when the product is run on a computer.
  • The aspects of the present invention may each be combined with any of the other aspects. These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Embodiments of the invention will be described, by way of example only, with reference to the drawings, in which
    • Figure 1 shows a reputation system according to the present invention for providing a measure of reliability of a first set of health data on a patient,
    • Figure 2 is a block diagram of one embodiment of a reputation system according to the present invention,
    • Figure 3 depicts graphically one embodiment of an interaction between a healthcare provider and the PHR system, and
    • Figure 4 shows a flowchart of a method according to the present invention for providing a measure of reliability of health data on a patient provided by a data provider.
    DESCRIPTION OF EMBODIMENTS
  • Figure 1 shows a reputation system 100 according to the present invention for providing a measure of reliability on a first set of health data 102 on a patient 103 provided by a data provider. The data provider can be the person that created the health data on the patient, e.g. the patient himself, a healthcare provider (e.g. a doctor, dentist or any person qualified to perform such measurements), a wellness provider (e.g. a person of a fitness center), or a computer or similar means that is pre-programmed to perform such measurements. The system comprises an assigner 105, a reputation-indicator 106 and a comparer 107.
  • The role of the assigner 105 is to assign ratings to the health data 102 or the data provider 103. In one embodiment the assigner 105 is a rule engine that computes rule ratings by relying on certificates of the data provider, e.g. the patient if he/she created the health data himself, or the wellness provider if it was the wellness provider that created the health data on the patient, or the healthcare provider if it is the healthcare provider that created the health data on the patient. Accordingly, the reliability of the data provider is reflected in the rule rating. The rule engine may implement different methods to find the rule ratings. As an example, the rule engine may be adapted to use a predefined mapping to find the rule ratings associated with a certificate. The certificates may e.g. be university diplomas, school or accreditation organization, tests, different types of courses, e.g. online courses etc. As an example, if the health data are created by the patient and the certificate indicates that he/she is very qualified in performing such a measurement, e.g. has participated in a number of courses related to how to create such health data, the rule rating would be evaluated as being high. Accordingly, the rule rating element reflects the "educational level" of the one that created the health data on the patient and is thus a good indicator for the "reliability" of the health data.
  • In one embodiment, the assigner 105 is an aggregation engine adapted to determine aggregation ratings based on comparing health data created by different data providers, preferably with a small time difference because the information can change with time. As an example, if the data providers is a doctor A and a patient B that do the same measurement on the patient and these measurements are similar, the aggregation ratings will be high, whereas an inconsistency in the measurements would result in lower aggregation ratings. Accordingly, the aggregation rating reflects a statistical reliability of the measured data.
  • In one embodiment, the assigner 105 is a healthcare provider, e.g. a doctor, which assigns health data that he/she receives with rating(s) after checking the data. This would typically be done based on being present when the data provider creates the health data, repeating creation of the health data etc. The rating assigned by the healthcare provider is referred to as local rating. As an example a doctor might assign blood pressure values measured by a patient over one week with ratings by assigning either the complete data set with a single rating element, or by assigning each data element with a rating element. This will be discussed in more details later.
  • In case the ratings provided for a data provider are provided by other healthcare providers, the ratings are referred to as global ratings.
  • Accordingly, the rating elements define the reliability parameter relating to the reliability of the measurement performed on the patient. As mentioned previously, if the rule rating is high the qualification of the data provider that created the health data is high, the local rating is e.g. given by a doctor assigning e.g. each respective data element with a rating, the global rating is when e.g. a second healthcare provider uses the local rating assigned by another healthcare provider, the aggregation rating relies on statistical procedure by comparing two or more measurements together and based thereon assigning the health data with an aggregation rating element. These rating elements serve as input for subsequent step performed by the reputation-indicator 106.
  • The role of the reputation-indicator 106 is to use the assigned rating elements as input data or input parameters in determining a first reputation measure for the data provider of the first set of health data. This first reputation measure determines the reputation of the data provider and thus reflects the reliability of the first set of data, i.e. whether they are trustworthy or not. A typical criterion is that they are accurate; the reliability is high, etc. The reputation-indicator 106 will be discussed in more details later.
  • The comparer 107 compares the first reputation measure with a threshold measure which is a measure of a pre-set reliability level of the data provider. The comparer can be e.g. a doctor, which is well aware of a reference level (a threshold measure) for evaluating whether the first reputation measure is sufficiently high and thus whether the reliability of the health data is sufficiently high. The comparer 107 can also be e.g. a processor which is pre-programmed to automatically compare the first reputation measure with a pre-set threshold measure.
  • In one embodiment, the reputation system 100 further comprises an instructor 108 to instruct, in case the determined reputation measure is below the reputation threshold measure, whether recreation of the health data is necessary or not based on whether the result from the comparer 107. If the determined reputation measure is below the reputation threshold measure at least a second set of health data can be created by the same data provider or a new data provider or the data could be discarded. Subsequently, at least one second rating elements are assigned to the second set of health data, a second reputation measure is determined based on the at least one second ratings elements and finally the second reputation measure is compared with the reputation threshold measure. This is repeated until the subsequent determined reputation measure reaches or exceeds the reputation threshold measure.
  • As depicted in Fig. 1, the health data may be personal health records (PHR) or electronic health records (EHR) obtained from an external database 109 over e.g. a wireless communication channel 111 such as the internet. Thus, a doctor can be provided with health data on the patient and check whether the health data are of high reliability or not.
  • The result of the instructor 108 could also be forwarded to an external agent 103, 110, e.g. a doctor 110 or the patient 103 over a wireless communication channel 111. If the response indicates that the reliability of the first set of health was not high enough, a data provider might be requested to repeat the measurements.
  • In one embodiment, the health data 102 are associated with metadata 104 for indicating how the health data creation process on the patient was performed, e.g. whether the blood pressure meter was placed at correct height during the measurement, or whether the patient was steady during the measurement etc. Accordingly, the metadata may reflect the context or circumstances of the measurement. This information may be very valuable for e.g. the doctor when assigning the local ratings simply by looking at the metadata. Such metadata are typically provided by the device that issues and attaches the metadata to the health data.
  • The above mentioned system could be integrated into e.g. a computer device 112, e.g. a PC computer, PDA or similar means comprising a processor for performing the above mentioned steps.
  • Figure 2 is a block diagram of one embodiment of a reputation system 100 according to the present invention, where the assigners 105 consist of rule engine 202, aggregation engine 207, and a healthcare provider 209.
  • The rule engine 202 can be a computer 202 or similar means comprising a processor where the computation relies on available certificates 201, e.g. pre-stored in a digital database. This would typically be digital information identifying certificates associated with the data provider. If e.g. no certificate is found about the data provider, the assigned rule elements 203 might be considered to be low (or zero), whereas if highly recognized certificate would be found for the health data provider (e.g. a doctor a the health data provider) the rule elements would be high.
  • The aggregation engine 207 typically performs a statistical evaluation or calculation on two or more sets of health data 208 on a patient and based thereon issues aggregation rating elements 206. Such a statistical evaluation could be performed by a computer or similar means.
  • The healthcare provider 209 assigns the health data 208 with local or global rating elements 205. As discussed previously, local rating is where e.g. a healthcare provider assigns the health data with rating element(s). As an example, patient A takes measurement and doctor B gives rating. If doctor B would calculate reputation of A this rating would be a local rating.
  • The global rating is where another healthcare provider uses a local rating to determine a first reputation measure. As an example, doctor C can use the rating provided by doctor B to calculate the reputation of patient A. In order to use the rating of doctor B, doctor C calculates a global rating (based on the rating given by doctor B).
  • To summarize, if doctor B gives a rating, this rating is a local rating for doctor B, and a global rating for doctor C.
  • As mentioned previously, in some cases the health data 208 has associated metadata 210 that provide additional information about e.g. the measurement procedure, or the type of the measurement device being used etc. These data can be highly relevant when assigning the health data with local rating elements. As an example, information about the model, e.g. the type/brand, of the measurement device that the patient used can be a relevant factor in evaluating how reliable the measurements are. Also, the additional information indicating that e.g. the relative position of the arm was correct when the blood pressure was measured could also be considered as highly relevant information.
  • These assigned rating elements are used as input data for calculating the reputation-measure 106/204, which determines the reputation measure 211 of the data provider, e.g. the healthcare provider, wellness provider, the patient. The higher the reputation measure is the higher is the reliability of the health data, and vice verse, the lower the reputation measure is the lower is the reliability of the health data.
  • If the reputation measure is below a pre-defined threshold reputation measure the health data should preferably be recreated, e.g. different measuring device, or a different data provider creating the health data.
  • When the reputation measure 211 is equal or larger than the threshold measure, a decision is issued 213 indicating whether the data provider, and thus the health data, may be considered to be reliable.
  • Begin of an embodiment
  • In this example, the rating element is a tuple (r,s,c) where r is the positive fraction of the rating, s is the negative fraction of the rating and c is the certainty of the rating. r, s and c are all real numbers between 0 and 1 and r and s satisfy the condition r+s=1. A reputation or reputation part is an aggregation of ratings. A reputation (part) is a tuple (R,S) where R is the combination of the positive fractions r of the ratings and S is the combination of the negative fractions s of the ratings. This model is an extension of the model for ratings and reputations introduced by Jøsang and Ismail ( A. Josang and R. Ismail, The Beta Reputation System, In Proc. 15th Bled Conf. Electronic Commerce, 2002 ) hereby incorporated by reference.
    The four different kinds of ratings (local, global, aggregation and rule ratings) can be divided into two categories: ratings for health data and rule ratings. Ratings from both categories need to be combined in different ways. In the next sections the different ways of combining the ratings of the different categories are discussed.
  • Combining ratings on health data:
  • This reputation part is based on ratings on health data (local, global and aggregation ratings). The positive fraction R of the reputation part is calculated by summing all positive fractions r of the local ratings. The positive fractions r of the ratings are scaled by several factors:
    • The certainty c: a rating with a high certainty should be given more weight than a rating with a low certainty.
    • The first forgetting function: a function that gives more weight to more recent ratings. Users may start behaving better (or worse) over time. Therefore, recent ratings should be given more weight than older ratings. The last rating should be given the highest weight, the one before slightly less weight, etc.
    • The second forgetting function: a function that gives more weight if the health data was created closer in time. As the time between the creation of the health data and the calculation of the reputation part increases, the rating should be given less weight. After all, if a user performed good (or bad) a very long time ago, there is no guarantee that he will do so now.
    • The similarity in scope function: if not enough ratings are available for calculating the reputation, ratings for other scopes can be used. A scope is a pair (m,d) where m is the measurement kind (e.g. blood pressure) and d is the device (e.g. Philips HF305 blood pressure meter) that is used. For the ratings to be useful, the scope for which the reputation is calculated has to be correlated to the scope of the ratings. The scope function is a function that gives more weight if the scopes are close to each other. This function has initial values for every pair of scopes and is updated dynamically.
    A reputation is the subjective judgment of a user x about a user y. A reputation is always calculated for a scope sc, a trusttype tt (either functional or recommendation) and for a time t. The positive fraction RH and the negative fraction SH of the reputation part are calculated as follows: R H x , y , sc , tt , t = j = 1 SC SS sc , s c j i = 1 H j g t i t f i H j c x , y , sc j , tt , t i i r x , y , sc j , tt , t i i
    Figure imgb0001
    S H x , y , sc , tt , t = j = 1 SC SS sc , s c j i = 1 H j g t i t f i H j c x , y , sc j , tt , t i i r x , y , sc j , tt , t i i
    Figure imgb0002
  • With:
  • SC
    The set of scopes.
    SS(sc,scj)
    A function returning the similarity between scopes sc and scj.
    Hj
    The set of local, global and aggregation ratings (rx,y,scj,tt,ti , Sx,y,scj,tt,ti , Cx,y,scj,tt,ti ) for scope j, ordered ascendingly by time of creation of the health data. Only ratings with time ti < t are present in the set.
    g(ti,t)
    The second forgetting function, giving higher values when ti is closer to t.
    f(i,|Hj|)
    The first forgetting function, giving higher values when i is closer to |Hj|.
    rx,y,sc,tt,t
    The positive fraction of the rating of x about y for scope sc, trust type tt and at time t.
    sx,y,sc,tt,t
    The negative fraction of the rating of x about y for scope sc, trust type tt and at time t.
    Cx,y,sc,tt,t
    The certainty of the rating of x about y for scope sc, trusttype tt and at time t.
    Combining rule ratings:
  • This reputation part is based on rule ratings. The positive fraction RR and the negative fraction SR of the reputation part are calculated as follows: R R x , y , sc , tt , t = i = 1 R c y , sc , tt , t i i r y , sc , tt , t i i
    Figure imgb0003
    S R x , y , sc , tt , t = i = 1 R c y , sc , tt , t i i s y , sc , tt , t i i
    Figure imgb0004
  • With:
  • R
    The set of rule ratings (ry,sc,tt,t, Sy,sc,tt,t, Cy,sc,tt,t) determined by the rule engine based on the possession of certificates by user y. Only ratings with time ti < t are present in the set.
    ry,sc,tt,t
    The positive fraction of the rating of x about y for scope sc, trust type tt and at time t. This value is determined by the rule engine based on possession of a certificate by user y.
    Sy,sc,tt,t
    The negative fraction of the rating of x about y for scope sc, trust type tt and at time t. This value is determined by the rule engine based on possession of a certificate by user y.
    Cy,sc,tt,t
    The certainty of the rating of x about y for scope sc, trust type tt and at time t. This value is determined by the rule engine based on possession of a certificate by user y.
    Combining rating on health data and rule ratings:
  • The two reputation parts (one on health data ratings and one on rule ratings) can be combined to obtain the reputation. The positive fraction R and the negative fraction S of the reputation are calculated as follows: R x , y , sc , tt , t = R H x , y , sc , tt , t + ω R R x , y , sc , tt , t
    Figure imgb0005
    S x , y , sc , tt , t = S H x , y , sc , tt , t + ω S R x , y , sc , tt , t
    Figure imgb0006

    where ω is the weight given to the reputation part based on rule ratings (ω ≥ 0).
  • Calculation of the ratings:
  • Local ratings: A local rating is a rating provided by a healthcare provider x after he checked the reliability of the health data that y supplied.
  • Global ratings: To gain a broader view about a user y, a user x can ask other users z about their ratings for y. Ratings from z should be discounted (i.e. given less weight) because a user's own ratings are always more reliable than another user's ratings. The ratings of other users are discounted by the recommendation reputation of the user z (the supplier the rating). The recommendation reputation of a user z is a pair (Rx,z,sc,R,t, Sx,z,sc,R,t) is calculated similarly to the functional reputation. However, for the recommendation only rule ratings and no ratings for health data are used.
  • Clearly, ratings from users with high recommendation reputation should be given more weight than users with low recommendation reputation. Therefore a rating of a user z can be easily discounted by his recommendation reputation by discounting the certainty of the rating. The discounted rating can then be calculated as follows: r x , y , sc , tt , t = r z , y , sc , tt , t
    Figure imgb0007
    s x , y , sc , tt , t = s z , y , sc , tt , t
    Figure imgb0008
    c x , y , sc , tt , t = R x , z , sc , R , t R x , z , sc , R , t + S x , z , sc , R , t + 2 c z , y , sc , tt , t
    Figure imgb0009
  • Aggregation ratings: The aggregation engine provides aggregation ratings that can be used for reputation computation by the reputation engine. An aggregation rating is computed by comparing measurements from different sources with a small time difference. If two users do the same measurement on the same person and these measurements are similar, then the reputation of both users can be increased. If two users do the same measurement on the same person and the measurements are not similar, then the reputation of both users must be decreased (In case of two users with similar reputations, this makes perfect sense. In case of a healthcare provider repeating a measurement of a patient, it is not necessary to change the reputation of the healthcare provider. In practice, the reputation of users with a very high reputation (e.g. healthcare providers) is only very slightly changed. Suppose hdy,z,(m,d),t is a measurement of user y on user z at time t. The measurement is of kind m and is taken with device d. D is a set of measurements hdyi,z(m,di)ti of the same kind and on the same person. D is chosen such that the measurements in D are close enough in time to infer information about the correctness of one of the measurement from the other(s). An aggregation rating can be calculated for hdy,z,(m,d),t as follows: r x , y , m d , F , t = SH h d y , z , m d , t , D , m
    Figure imgb0010
    s x , y , m d , F , t = 1 - SH h d y , z , m d , t , D , m
    Figure imgb0011
    c x , y , m d , F , t = i = 1 D ST t t i m R x , y i , m d i , F , t i = 1 D ST t t i m R x , y i , m d i , F , t i + R x , y i , m d i , F , t i + 2
    Figure imgb0012

    where SH(hdy,z,(m,d),t, ,D,m) is the function that compares the measurement hdy,z,(m,d),t to the measurements in the set D. As part of calculating SH, first the most probable value for hdy,z(m,d),t based on the measurements in the set D is calculated. Second, the similarity between hdy,z,(m,d),t and this most probable value is computed.
  • The most probable value is a weighted average of the measurements of the same kind on the same patient: mpv hd y , z , m d , t D = i = 1 D h d y , z , m d , t ST t t i m h d y i , z , m d i , t i i = 1 D h d y , z , m d , t ST t t i m
    Figure imgb0013
  • The weights of the equation are the similarities in time between the measurements. The similarity in time ST(t,ti,m) is calculated as follows: ST t t i m = e - t - t i 2 2 σ time , m 2
    Figure imgb0014

    where σtime,m is the standard deviation for time belonging to measurement kind m.
  • The similarity of the measurement hdy,z,(m,d),t is then calculated by: SH hd y , z , m d , t D m = e - hd y , z , m d , t - mpv hd y , z , m d , t D 2 2 σ hd , m 2
    Figure imgb0015

    where σhd,m is the standard deviation for health data belonging to measurement kind m.
  • Rule ratings: The rule engine computes rule ratings that can be used by the reputation engine. The computation relies on available certificates. Certificates may be diplomas from a university, school or accreditation organization. Another possibility for obtaining a certificate is by following an online course and passing a test. A certificate is represented as a tuple (x, p, t) stating property p about user x, where p can be any property leading to a rule rating (e.g. 'completed medical school' or 'successfully completed online tutorial for measuring blood pressure') and t is the time of creation of the certificate.
  • The rule engine maps certificates to rule ratings (rx,sc,tt,t, sx,sc,tt,t, cx,sc,tt,t) using a predefined mapping. Every time a new type of certificate is accepted, or a new scope is introduced, the mapping has to be updated. The mapping can be represented as a lookup table.
  • Interactions with the PHR system:
  • The interactions between the patient and the PHR system as well as between the wellness provider and the PHR system have changed in such a way that the health data that is sent to the PHR system by these suppliers or data providers can be accompanied by metadata. This metadata can be used by the PHR system and the healthcare provider to calculate a rating. For the healthcare provider, the interaction with the PHR system has changed such that they can obtain reputations and supply ratings (A situation where the wellness provider (and even the patient) would also obtain the reputation of the data provider of the health data will also be needed. After all, a reputation is (and should be) public information. In this situation, the interactions between the wellness provider (and patient) and PHR system are similar to the one in figure 3). Instead of obtaining health data from the PHR system, the healthcare provider also obtains metadata on this health data and the reputation of the data provider of the health data at the time of creation of the health data. After obtaining the health data, the healthcare provider can choose to supply a rating for the health data. The other option is that the healthcare provider repeats a measurement and adds the measurement to the PHR of the user. The reputation system then automatically calculates an aggregation rating.
  • One embodiment of the interaction between a healthcare provider 301 and the PHR system 302 is depicted in figure 3, and includes the following steps:
    Healthcare provider 301 x requests health data on patient y for scope sc created at time t.
    The PHR system 302 verifies the identity of x and if x is has sufficient access rights, the PHR system sends the health data to x. If any metadata provided by the device is available, the PHR system also sends this to x. The health data and metadata are accompanied by the reputation of the data provider of the data at time of creation of the data.
    If no rating has been provided for this health data, x sends his rating for the health data to the PHR system. This step is optional.
  • End the embodiment. Begin example 1: Blood pressure (part 1):
  • "Lately, Alice has not been feeling well. She sometimes has a blurred vision and she regularly has headaches. Alice decides to pay her general practitioner, Dr. Bob, a visit. Bob measures Alice's blood pressure and finds her blood pressure to be rather high (160/100 mmHg). High blood pressure significantly increases the risk of heart failure and the risk of stroke. Therefore, Bob decides that from now on, Alice has to measure her blood pressure every day. Alice decides she will measure her blood pressure using a sphygmomanometer. As blood pressure changes during the day, Alice always measures her blood pressure at the end of her working day. In the first week, Alice measures the blood pressure values depicted in table 1. Table 1: Blood pressure values of the first week
    Day Systolic BP Diastolic BP
    Monday 170 mmHg 110 mmHg
    Tuesday 165 mmHg 105 mmHg
    Wednesday 140 mmHg 90 mmHg
    Thursday 155 mmHg 100 mmHg
    Friday 160 mmHg 100 mmHg
  • Bob is not quite sure about the measurements Alice provides. He expresses this by providing average ratings with very high uncertainty."
  • Bob provides the following ratings: r B , A , bp sphyg , 101 s B , A , bp sphyg , 101 c B , A , bp sphyg , 101 = 0.5 0.5 0.2
    Figure imgb0016
    r B , A , bp sphyg , 102 s B , A , bp sphyg , 102 c B , A , bp sphyg , 102 = 0.5 0.5 0.2
    Figure imgb0017
    r B , A , bp sphyg , 103 s B , A , bp sphyg , 103 c B , A , bp sphyg , 103 = 0.5 0.5 0.2
    Figure imgb0018
    r B , A , bp sphyg , 104 s B , A , bp sphyg , 104 c B , A , bp sphyg , 104 = 0.5 0.5 0.2
    Figure imgb0019
    r B , A , bp sphyg , 105 s B , A , bp sphyg , 105 c B , A , bp sphyg , 105 = 0.5 0.5 0.2
    Figure imgb0020
  • "Because the ratings vary a lot, Bob asks Dr. Charlie to check on Monday whether Alice measures her blood pressure in a proper way. As Charlie is Alice's company doctor, he has completed medical school and therefore he can provide recommendations to Bob. Unfortunately, Charlie observes that Alice measures her blood pressure quite clumsily and that she has quite some difficulties handling the sphygmomanometer. Therefore, Charlie provides a bad rating for Alice's measurement."
  • Charlie's rating for Alice is represented by: r C , A , bp sphyg , F , 108 s C , A , bp sphyg , F , 108 c C , A , bp sphyg , F , 108 = 0.1 0.9 1
    Figure imgb0021
  • Charlie's recommendation reputation is represented by: R B , C , bp sphyg , R , 108 = 11.25 S B , C , bp sphyg , R , 108 = 1.25
    Figure imgb0022
  • The global rating of Bob for Alice through Charlie is then calculated by: r B , A , bp sphyg , F , 108 = 0.1
    Figure imgb0023
    s B , A , bp sphyg , F , 108 = 0.9
    Figure imgb0024
    c B , A , bp sphyg , F , 108 = 11.25 11.25 + 1.25 + 2 1 = 0.7759
    Figure imgb0025
  • "Providing highly reliable measurements is in the interest of both Alice and Bob. Therefore, Bob recommends using a Braun BP3550 blood pressure monitor with advanced positioning sensors. For measuring blood pressure, it is important to position the blood pressure meter at heart level. The health data provided by the BP3550 is accompanied by metadata. This metadata contains information on whether the arm was positioned at the right level. Therefore, Bob can make a more informed decision on the reliability of the health data. Additionally, Alice takes an online tutorial on how to measure her blood pressure using the Braun BP3550. Therefore, her reputation for taking blood pressure measurements using the BP3550 is increased."
  • The rule engine has calculated the following rule rating for Alice: r A , bp , BP 3550 , F , 108 s A , bp , BP 3550 , F , 108 c A , bp , BP 3550 , F , 108 = 0.7 0.3 0.1
    Figure imgb0026
  • "The blood pressure values for the rest of the second week are depicted in table 2." Table 2: Blood pressure values for the second week
    Day Systolic BP Diastolic BP
    Tuesday 162 mmHg 101 mmHg
    Wednesday 158 mmHg 102 mmHg
    Thursday 155 mmHg 95 mmHg
    Friday 160 mmHg 101 mmHg
  • Bob provides the following ratings: r B , A , bp , BP 3550 , 109 s B , A , bp , BP 3550 , 109 c B , A , bp , BP 3550 , 109 = 0.8 0.2 0.6
    Figure imgb0027
    r B , A , bp , BP 3550 , 110 s B , A , bp , BP 3550 , 110 c B , A , bp , BP 3550 , 110 = 0.8 0.2 0.6
    Figure imgb0028
    r B , A , bp , BP 3350 , 111 s B , A , bp , BP 3350 , 111 c B , A , bp , BP 3350 , 111 = 0.8 0.2 0.6
    Figure imgb0029
    r B , A , bp , BP 3550 , 112 s B , A , bp , BP 3550 , 112 c B , A , bp , BP 3550 , 112 = 0.8 0.2 0.6
    Figure imgb0030
  • "As the blood pressure values remain to be too high, Alice pays another visit to Bob. Bob asks Alice to do a measurement using her blood pressure meter. After Alice has done her measurement, Bob immediately repeats Alice's measurement using his own equipment. This way, Bob can be sure that Alice's blood pressure has not changed between the two measurements. The system automatically observes that the measurements of Alice and Bob are very close and as Bob is a doctor, Alice's reputation is increased."
  • Alice measures a blood pressure value of 179 and Bob measures a blood pressure value of 180. Therefore, the aggregation rating is high. Because Bob measures the blood pressure within a minute, the certainty of the rating is also high. The aggregation engine calculates the following aggregation rating, based on Alice's and Bob's measurement: r B , A , bp , BP 3550 , F , 122 s B , A , bp , BP 3550 , F , 122 c B , A , bp , BP 3550 , F , 122 = 0.9729 0.027 0.8832
    Figure imgb0031
  • The functional reputation for taking blood pressure measurements with the Braun BP3550 can be calculated using the ratings for health data and the rule ratings. For this, the functional reputation part using ratings for health data needs to be computed. The functional reputation part based on rule ratings needs to be calculated separately.
  • The scope function is defined as:
    (bp,sphyg) (bp,BP3550) (bp,HEM650)
    (bp,sphyg) 1 0.3 0.3
    (bp,BP3550) 0.3 1 0.8
    (bp,HEM650) 0.3 0.8 1
  • The first forgetting function is represented by: f i j = 1 1 + j - i λ
    Figure imgb0032
  • With λ=0.25
  • The second forgetting function is represented by: g i j = λ j - i
    Figure imgb0033
  • With λ=0.9999
  • The functional reputation value for taking blood pressure measurements with the Braun BP3550 of Alice for Bob at time t = 122 is then calculated as follows: R H B , A , bp , BP 3550 , F , 122 = SS bp , BP 3550 bp sphyg g 101 122 f 1 6 0.2 0.5 + g 108 122 f 6 6 0.7759 0.1 ) + SS bp , BP 3550 bp , BP 3550 g 109 122 f 1 5 0.6 0.8 + g 122 122 f 5 5 0.8832 0.9729 ) = 2.4179
    Figure imgb0034
    S H B , A , bp , BP 3550 , F , 122 = SS bp , BP 3550 bp sphyg g 101 122 f 1 6 0.2 0.5 + g 108 122 f 6 6 0.7759 0.9 ) + SS bp , BP 3550 bp , BP 3550 g 109 122 f 1 5 0.6 0.2 + g 122 122 f 5 5 0.8832 0.0271 ) = 0.6982
    Figure imgb0035
  • The functional reputation part based on rule ratings computed as follows: R R A , bp , BP 3550 , F , 122 = i = 1 R c A , bp , BP 3550 , F , t r A , bp , BP 3550 , F , t = 0.1 0.7 = 0.7
    Figure imgb0036
    S R A , bp , BP 3550 , F , 122 = i = 1 R c A , bp , BP 3550 , F , t s A , bp , BP 3550 , F , t = 0.1 0.3 = 0.03
    Figure imgb0037
  • The reputation of Bob for Alice can be calculated by combining the reputation part based on ratings for health data and the reputation part based on rule ratings: R B , A , bp , BP 3550 , F , 122 = R H B , A , bp , BP 3550 , F , 122 + ω R R A , bp , BP 3550 , F , 122 = 2.4179 + 25 0.07 = 4.1679
    Figure imgb0038
    S B , A , bp , BP 3550 , F , 122 = S H B , A , bp , BP 3550 , F , 122 + ω S R A , bp , BP 3550 , F , 122 = 0.6982 + 25 0.03 = 1.4482
    Figure imgb0039
  • Blood pressure (part 2):
  • Ten years later, Alice is again diagnosed with high blood pressure. In the meantime, Dr. David has taken over Bob's doctor's practice. David is not sure whether he should trust the measurements provided by Alice. David has never given any ratings on the measurements provided by Alice. Because David trusts Bob for providing recommendations on doing measurements, David can trust Bob's ratings on Alice's measurements. Therefore, in David's eyes, Alice has a good reputation for measuring blood pressure with the BP3550 and a bad reputation for measuring blood pressure using a sphygmomanometer. Because the reputation is based on 10-year-old measurements it expresses more uncertainty than 10 years ago. Moreover, certainty is decreased because David is computing the reputation based on ratings provided by Bob. Also, Alice has bought a new blood pressure meter, the Omron HEM650 with advanced positioning sensors. Like the BP3550, the HEM650 also provides metadata on whether the arm was positioned on the right level. Alice has no ratings for measuring blood pressure using the HEM650. Therefore, the ratings for measuring blood pressure using a sphygmomanometer and using the BP3550 are used to calculate the reputation for using the HEM650. Because using the BP3550 is more similar to using the HEM650 than using the sphygmomanometer, the ratings for using the BP3550 are given more weight than the ratings for using the sphygmomanometer.
  • The local ratings given by Bob and Charlie in the past can be used by David to calculate Alice's reputation. However, the ratings need to be discounted by the recommendation reputation of David for Bob and Charlie. Throughout the scenario, it is assumed that Bob and Charlie have the following recommendation reputation (for all t): R D , C , bp , BP 3550 , R , t = 11.875 S D , C , bp , BP 3550 , R , t = 0.625
    Figure imgb0040
    R D , C , bp sphyg , R , t = 11.25 S D , C , bp sphyg , R , t = 1.25
    Figure imgb0041
    R D , B , bp sphyg , R , t = 11.25 S D , B , bp sphyg , R , t = 1.25
    Figure imgb0042
  • The global ratings of David for Alice are the following: r D , A , bp sphyg , 101 s D , A , bp sphyg , 101 c D , A , bp sphyg , 101 = 0.5 0.5 0.1552
    Figure imgb0043
    r D , A , bp sphyg , 102 s D , A , bp sphyg , 102 c D , A , bp sphyg , 102 = 0.5 0.5 0.1552
    Figure imgb0044
    r D , A , bp sphyg , 103 s D , A , bp sphyg , 103 c D , A , bp sphyg , 103 = 0.5 0.5 0.1552
    Figure imgb0045
    r D , A , bp sphyg , 104 s D , A , bp sphyg , 104 c D , A , bp sphyg , 104 = 0.5 0.5 0.1552
    Figure imgb0046
    r D , A , bp sphyg , 105 s D , A , bp sphyg , 105 c D , A , bp sphyg , 105 = 0.5 0.5 0.1552
    Figure imgb0047
    r D , A , bp sphyg , 108 s D , A , bp sphyg , 108 c D , A , bp sphyg , 108 = 0.1 0.9 0.7759
    Figure imgb0048
    r D , A , bp , BP 3550 , 109 s D , A , bp , BP 3550 , 109 c D , A , bp , BP 3550 , 109 = 0.8 0.2 0.4914
    Figure imgb0049
    r D , A , bp , BP 3550 , 110 s D , A , bp , BP 3550 , 110 c D , A , bp , BP 3550 , 110 = 0.8 0.2 0.4914
    Figure imgb0050
    r D , A , bp , BP 3550 , 111 s D , A , bp , BP 3550 , 111 c D , A , bp , BP 3550 , 111 = 0.8 0.2 0.4914
    Figure imgb0051
    r D , A , bp , BP 3550 , 112 s D , A , bp , BP 3550 , 112 c D , A , bp , BP 3550 , 112 = 0.8 0.2 0.4914
    Figure imgb0052
  • The aggregation rating for the measurements taken by Alice and Bob at t = 122 can also be calculated by David: r D , A , bp , BP 3550 , F , 122 s D , A , bp , BP 3550 , F , 122 c D , A , bp , BP 3550 , F , 122 = 0.9729 0.0271 0.8832
    Figure imgb0053
  • "When Alice provides blood pressure measurements with the HEM650, David is provided with the reputation information about Alice."
    The functional reputation at t = 3750 is calculated as follows: R D , A , bp , HEM 650 , F , 3750 = SS bp , HEM 650 bp sphyg g 101 3750 f 1 6 0.1552 0.5 + g 108 3750 f 6 6 0.7759 0.1 ) + SS bp , HEM 650 bp , BP 3550 g 109 3750 f 1 5 0.4919 0.8 + g 122 3750 f 5 5 0.8832 0.9729 ) = 1.2034
    Figure imgb0054
    S D , A , bp , HEM 650 , F , 3750 = SS bp , HEM 650 bp sphyg g 101 3750 f 1 6 0.1552 0.5 + g 108 3750 f 6 6 0.7759 0.9 ) + SS bp , HEM 650 bp , BP 3550 g 109 3750 f 1 5 0.4919 0.2 + g 122 3750 f 5 5 0.8832 0.0271 ) = 0.3799
    Figure imgb0055
  • "Alice's reputation is quite good, but shows quite some uncertainty. The uncertainty is due to the old ratings and the different equipment. Therefore, David decides that he wants to redo a measurement. Because the measurements provided by Alice and David are similar, David gives Alice a good rating. Alice's reputation is increased and the certainty of this reputation is increased. From now on, David trusts Alice's measurements, as long as the metadata shows that the arm position is alright."
  • The rating provided by David is the following: r D , A , bp , HEM 650 , F , 3750 s D , A , bp , HEM 650 , F , 3750 c D , A , bp , HEM 650 , F , 3750 = 1 0 1
    Figure imgb0056
  • The reputation of Alice is now: R D , A , bp , HEM 650 , F , 3750 = 2.2034 S D , A , bp , HEM 650 , F , 3750 = 0.3799
    Figure imgb0057
  • End example 1
  • Figure 4 shows a flowchart of a method according to the present invention for providing a measure of reliability of a first set on health data 102a on a patient provided by a data provider. In a first step (S1) 401 the health data or the data provider are assigned with at least one rating element, and the assigned rating element is used (S2) 402 as input data in determining (S3) 403 a first reputation measure, the first reputation measure indicating the reliability of the data provider. The first reputation measure is compared 404 with a pre-defined reputation threshold measure, the reputation threshold measure being a measure of a pre-set reliability level set by the healthcare provider. In one embodiment, if the reputation measure is below the reputation threshold measure (S4) 405, a second set of health data is created resulting in a second data set 102b and steps S1-S3 are repeated. Otherwise, the first set of health data 102a is considered to be reliable (S5) 405.
  • Certain specific details of the disclosed embodiment are set forth for purposes of explanation rather than limitation, so as to provide a clear and thorough understanding of the present invention. However, it should be understood by those skilled in this art, that the present invention might be practiced in other embodiments that do not conform exactly to the details set forth herein, without departing significantly from the spirit and scope of this disclosure. Further, in this context, and for the purposes of brevity and clarity, detailed descriptions of well-known apparatuses, circuits and methodologies have been omitted so as to avoid unnecessary detail and possible confusion.
  • Reference signs are included in the claims, however the inclusion of the reference signs is only for clarity reasons and should not be construed as limiting the scope of the claims.
  • Claims (13)

    1. A reputation system for providing a measure of reliability on a first set of health data (102) on a patient (103) provided by a data provider, the system comprising:
      a) an assigner (105) for assigning the first set of health data or the data provider with at least one first rating element,
      b) a reputation-indicator (106) for using the at least one first rating element as input data in determining a first reputation measure indicating the reliability of the data provider, and
      c) a comparer (107) for comparing the determined first reputation measure with a pre-defined reputation threshold measure, the reputation threshold measure being a measure of a pre-set reliability level of the data provider.
    2. A reputation system according to claim 1, wherein the assigner comprises a rule engine (202) adapted to determine ratings for the data provider associated with certificates of the data provider.
    3. A reputation system according to claim 1, wherein the assigner comprises an aggregation engine (207) adapted to determine ratings for the health data based on comparing two or more health data sets on the same patient provided by different data providers.
    4. A reputation system according to claim 3, wherein the aggregation engine (207) determines the ratings for the health data by calculating the consistency between the two or more health data sets.
    5. A reputation system according to claim 1, wherein the assigner (105) comprises a healthcare provider or a wellness provider which assigns by a manual operation the health data with the at least one rating element.
    6. A reputation system according to claim 1, wherein the rating means comprises a metadata source for incorporating metadata (104) to the health data, the metadata being implemented as additional data source in assigning the health data with at least one rating element.
    7. A reputation system according to claim 1, wherein the data provider is the patient or a wellness provider.
    8. A reputation system according to claim 1, wherein the data provider is a healthcare provider (209).
    9. A reputation system according to claim 1, wherein the first set of health data (102) as well as the accompanying metadata (104) is obtained from an external database (109) or system over a communication channel (111).
    10. A reputation system according to claim 1, wherein the first reputation measure related to health data (102) is sent over a communication channel (111) to a remote system.
    11. A reputation system according to claim 1, wherein the rating relating to a first set of health data (102) is sent over a communication channel (111) to a remote system.
    12. A method of providing a measure of reliability on a first set of health data on a patient provided by a data provider, comprising:
      a) assigning (401) the first set of health data or the data provider with at least one rating element,
      b) using the assigned rating element (402) as input data (403) in determining a first reputation measure indicating the reliability of the data provider, and
      c) comparing the determined first reputation measure with a pre-defined reputation threshold measure (404), the reputation threshold measure being a measure of a pre-set reliability level of the data provider.
    13. A computer program product for instructing a processing unit to execute the method step of claim 12 when the product is run on a computer.
    EP20070109798 2007-06-07 2007-06-07 A reputation system for providing a measure of reliability on health data Ceased EP2000934A1 (en)

    Priority Applications (1)

    Application Number Priority Date Filing Date Title
    EP20070109798 EP2000934A1 (en) 2007-06-07 2007-06-07 A reputation system for providing a measure of reliability on health data

    Applications Claiming Priority (7)

    Application Number Priority Date Filing Date Title
    EP20070109798 EP2000934A1 (en) 2007-06-07 2007-06-07 A reputation system for providing a measure of reliability on health data
    CN 200880018954 CN101681400A (en) 2007-06-07 2008-06-04 A reputation system for providing a measure of reliability on health data
    EP20080763190 EP2168065A1 (en) 2007-06-07 2008-06-04 Reputation system for providing a measure of reliability on health data
    PCT/IB2008/052186 WO2008149300A1 (en) 2007-06-07 2008-06-04 A reputation system for providing a measure of reliability on health data
    US12602725 US20100179832A1 (en) 2007-06-07 2008-06-04 A reputation system for providing a measure of reliability on health data
    JP2010510940A JP2010529549A (en) 2007-06-07 2008-06-04 Reputation system that provides a measure of the reliability of the health data
    RU2009148298A RU2009148298A (en) 2007-06-07 2008-06-04 reputation system to ensure the reliability index of health data

    Publications (1)

    Publication Number Publication Date
    EP2000934A1 true true EP2000934A1 (en) 2008-12-10

    Family

    ID=38535620

    Family Applications (2)

    Application Number Title Priority Date Filing Date
    EP20070109798 Ceased EP2000934A1 (en) 2007-06-07 2007-06-07 A reputation system for providing a measure of reliability on health data
    EP20080763190 Withdrawn EP2168065A1 (en) 2007-06-07 2008-06-04 Reputation system for providing a measure of reliability on health data

    Family Applications After (1)

    Application Number Title Priority Date Filing Date
    EP20080763190 Withdrawn EP2168065A1 (en) 2007-06-07 2008-06-04 Reputation system for providing a measure of reliability on health data

    Country Status (6)

    Country Link
    US (1) US20100179832A1 (en)
    EP (2) EP2000934A1 (en)
    JP (1) JP2010529549A (en)
    CN (1) CN101681400A (en)
    RU (1) RU2009148298A (en)
    WO (1) WO2008149300A1 (en)

    Cited By (1)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JP2013539114A (en) * 2010-08-23 2013-10-17 コーニンクレッカ フィリップス エヌ ヴェ Cases assigned to the case evaluators based on the dynamic evaluation's profile

    Families Citing this family (4)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US20110029365A1 (en) * 2009-07-28 2011-02-03 Beezag Inc. Targeting Multimedia Content Based On Authenticity Of Marketing Data
    CN105519039A (en) * 2013-09-29 2016-04-20 迈克菲股份有限公司 Threat intelligence on a data exchange layer
    CN105808769A (en) * 2016-03-21 2016-07-27 华南师范大学 Data acquisition method and system facing big data and generic data
    CN106650203A (en) * 2016-09-28 2017-05-10 江西博瑞彤芸科技有限公司 Parameter threshold dynamic updating method

    Citations (7)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US20020004758A1 (en) * 2000-07-07 2002-01-10 Mineki Takechi Information ranking system, information ranking method, and computer-readable recording medium recorded with information ranking program
    WO2002061549A2 (en) * 2001-01-31 2002-08-08 Hermanus Johannes Potgieter A central assessment and evaluation system and method
    EP1233354A1 (en) * 2001-02-15 2002-08-21 Hitachi, Ltd. Rating information publishing system
    US20030101166A1 (en) * 2001-11-26 2003-05-29 Fujitsu Limited Information analyzing method and system
    WO2004031982A1 (en) * 2002-10-04 2004-04-15 Tenix Investments Pty Ltd Data quality & integrity engine
    EP1566758A1 (en) * 2004-02-18 2005-08-24 AT&amp;T Corp. Implementing data quality using rule bases and knowledge engineering
    US7031952B1 (en) * 1999-10-08 2006-04-18 Knowledge Filter, Inc. Knowledge filter

    Family Cites Families (8)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    WO2001095214A1 (en) * 2000-06-02 2001-12-13 Quality Metric Method and system for health assessment and monitoring
    US20020013906A1 (en) * 2000-06-14 2002-01-31 Walter Wallach Secure medical test and result delivery system
    US6512986B1 (en) * 2000-12-30 2003-01-28 Lifescan, Inc. Method for automated exception-based quality control compliance for point-of-care devices
    US20030125609A1 (en) * 2001-08-03 2003-07-03 Robert Becker Method for reliable measurement in medical care and patient self monitoring
    US20030163349A1 (en) * 2002-02-28 2003-08-28 Pacificare Health Systems, Inc. Quality rating tool for the health care industry
    US20080103816A1 (en) * 2006-10-30 2008-05-01 National Committee For Quality Assurance Physician accreditation system with mechanism for automated records extraction
    US8996988B2 (en) * 2009-10-19 2015-03-31 Browsera, LLC Automated application compatibility testing
    US8774946B2 (en) * 2009-12-29 2014-07-08 Verizon Patent And Licensing Inc. Method and system for accurately determining service provider assets

    Patent Citations (7)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US7031952B1 (en) * 1999-10-08 2006-04-18 Knowledge Filter, Inc. Knowledge filter
    US20020004758A1 (en) * 2000-07-07 2002-01-10 Mineki Takechi Information ranking system, information ranking method, and computer-readable recording medium recorded with information ranking program
    WO2002061549A2 (en) * 2001-01-31 2002-08-08 Hermanus Johannes Potgieter A central assessment and evaluation system and method
    EP1233354A1 (en) * 2001-02-15 2002-08-21 Hitachi, Ltd. Rating information publishing system
    US20030101166A1 (en) * 2001-11-26 2003-05-29 Fujitsu Limited Information analyzing method and system
    WO2004031982A1 (en) * 2002-10-04 2004-04-15 Tenix Investments Pty Ltd Data quality & integrity engine
    EP1566758A1 (en) * 2004-02-18 2005-08-24 AT&amp;T Corp. Implementing data quality using rule bases and knowledge engineering

    Non-Patent Citations (5)

    * Cited by examiner, † Cited by third party
    Title
    CHAUDHURI S ET AL: "An Overview of Data Warehousing and OLAP Technology", SIGMOD RECORD, SIGMOD, NEW YORK, NY, US, vol. 26, no. 1, March 1997 (1997-03-01), pages 65 - 74, XP002193792, ISSN: 0163-5808 *
    JADAD A R ET AL: "Rating health information on the Internet: navigating to knowledge or to Babel?", JAMA : THE JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION 25 FEB 1998, vol. 279, no. 8, 25 February 1998 (1998-02-25), pages 611 - 614, XP002453771, ISSN: 0098-7484 *
    LEITHEISER R L: "Data quality in health care data warehouse environments", SYSTEM SCIENCES, 2001. PROCEEDINGS OF THE 34TH ANNUAL HAWAII INTERNATIONAL CONFERENCE ON JANUARY 3-6, 2001, PISCATAWAY, NJ, USA,IEEE, 3 January 2001 (2001-01-03), pages 2114 - 2123, XP010549832, ISBN: 0-7695-0981-9 *
    WANG R Y: "A product perspective on total data quality management", COMMUNICATIONS OF THE ACM ACM USA, vol. 41, no. 2, February 1998 (1998-02-01), pages 58 - 65, XP002453770, ISSN: 0001-0782 *
    ZACHARIA G ET AL: "Trust management through reputation mechanisms", APPLIED ARTIFICIAL INTELLIGENCE TAYLOR & FRANCIS UK, vol. 14, no. 9, October 2000 (2000-10-01), pages 881 - 907, XP002453769, ISSN: 0883-9514 *

    Cited By (1)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JP2013539114A (en) * 2010-08-23 2013-10-17 コーニンクレッカ フィリップス エヌ ヴェ Cases assigned to the case evaluators based on the dynamic evaluation's profile

    Also Published As

    Publication number Publication date Type
    CN101681400A (en) 2010-03-24 application
    RU2009148298A (en) 2011-07-27 application
    JP2010529549A (en) 2010-08-26 application
    WO2008149300A1 (en) 2008-12-11 application
    EP2168065A1 (en) 2010-03-31 application
    US20100179832A1 (en) 2010-07-15 application

    Similar Documents

    Publication Publication Date Title
    Rubin et al. The advantages and disadvantages of process‐based measures of health care quality
    Buist et al. The burden of obstructive lung disease initiative (BOLD): rationale and design
    Motheral et al. A checklist for retrospective database studies—report of the ISPOR Task Force on Retrospective Databases
    US6336136B1 (en) Internet weight reduction system
    US20060274145A1 (en) Method and apparatus for automated quality assurance in medical imaging
    US20060112050A1 (en) Systems and methods for adaptive medical decision support
    US6370511B1 (en) Computer-implemented method for profiling medical claims
    US20050137910A1 (en) Systems and methods for automated extraction and processing of billing information in patient records
    US20080046268A1 (en) Dynamic modeling and scoring risk assessment
    US20030149597A1 (en) System for supporting clinical decision-making
    US20060047188A1 (en) Method and system for triage of emergency patients
    Epstein et al. Patient-centered communication and diagnostic testing
    US20060265253A1 (en) Patient data mining improvements
    Hsiao et al. An overview of the development and refinement of the Resource-Based Relative Value Scale: the foundation for reform of US physician payment
    US6193654B1 (en) Computerized method and system for measuring and determining neonatal severity of illness and mortality risk
    US20070043595A1 (en) System, method and computer software product for estimating costs under health care plans
    Roberfroid et al. Physician supply forecast: better than peering in a crystal ball?
    US6529876B1 (en) Electronic template medical records coding system
    US20050222867A1 (en) System and method for administering health care cost reduction
    US20050182658A1 (en) Method of improving a clinical study
    Kendall Designing a research project: randomised controlled trials and their principles
    Martínez-Pérez et al. Mobile clinical decision support systems and applications: a literature and commercial review
    US20030212580A1 (en) Management of information flow and workflow in medical imaging services
    US20070179811A1 (en) Method and apparatus for generating an administrative quality assurance scorecard
    McLean et al. Deprivation and quality of primary care services: evidence for persistence of the inverse care law from the UK Quality and Outcomes Framework

    Legal Events

    Date Code Title Description
    AX Request for extension of the european patent to

    Countries concerned: ALBAHRMKRS

    AK Designated contracting states:

    Kind code of ref document: A1

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

    AKX Payment of designation fees
    18R Refused

    Effective date: 20090416

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: 8566