WO2019155267A1 - Plateforme d'intelligence artificielle de technologie médicale intégrative - Google Patents

Plateforme d'intelligence artificielle de technologie médicale intégrative Download PDF

Info

Publication number
WO2019155267A1
WO2019155267A1 PCT/IB2018/052161 IB2018052161W WO2019155267A1 WO 2019155267 A1 WO2019155267 A1 WO 2019155267A1 IB 2018052161 W IB2018052161 W IB 2018052161W WO 2019155267 A1 WO2019155267 A1 WO 2019155267A1
Authority
WO
WIPO (PCT)
Prior art keywords
medical
treatment
patient
data
query
Prior art date
Application number
PCT/IB2018/052161
Other languages
English (en)
Inventor
Benjamin Hong
Victor Tan
Yongli Hu
Parimala SIVARAJ
Original Assignee
Iota Medtech Pte. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Iota Medtech Pte. Ltd. filed Critical Iota Medtech Pte. Ltd.
Publication of WO2019155267A1 publication Critical patent/WO2019155267A1/fr

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Definitions

  • the application relates to a system for collection and analy sis of healthcare related data.
  • These medical data can include text that are provided in vari ous forms, such as structured text, semi-structured text, and unstructured text.
  • the medical data can also include video, audio, and image information.
  • These medical data can be gener ated and collected on a multitude of different platforms, such as social media portals, Internet of Things (IoT) sensor net works, and health record systems.
  • IoT Internet of Things
  • the application provides a personalized healthcare system that comprises a computer.
  • the personalized healthcare system re fers to a computer implemented system for providing healthcare services for diagnosing health issues of patients and for providing treatments that are personalized or customized for the respective patients .
  • the computer includes a communication interface for receiving medical image data and corresponding medical diagnoses of dif ferent patients, corresponding medical treatment histories of the different patients, and medical literature from various sources, such as clinics, hospitals, and medical institutions or health statutory organizations.
  • the medical image data re fers to, for an example, images of human body parts, human tissues, or human organs for use in clinical diagnosis.
  • the medical literature refers to, for an example, scientific lit erature, which includes articles in journals and books.
  • the computer also includes a computing processor for executing instructions of a diagnosis and treatment software program.
  • This diagnosis and treatment software program includes a data management component.
  • the data management component comprises a plurality of databases.
  • the databases refer to a collection of information that is organized so that it can be easily ac Completed, managed and updated. These databases are intended for storing the medical image data and the corresponding medical diagnoses of different patients, the corresponding medical treatment histories of the different patients, and the medical literature, which are received from the various sources.
  • the diagnosis and treatment software program also includes an analytics component, which includes a plurality of modular an alytics modules. These modular analytics modules can be put together in different combinations to perform different tasks or functions .
  • the plurality of modular analytics modules includes a data fu sion module for integrating the received medical image data and the corresponding medical diagnoses, the received corre sponding medical treatment histories, and the received medical literature to provide treatment plan datasets.
  • the treatment plan datasets contain integrated data, which have been parsed, cleaned, transformed, and harmonized for im proved data quality.
  • the analytics modules also include an image analytic module for constructing a model of the medical image data and the corresponding medical diagnoses using a machine learning algo rithm and for providing or identifying a possible diagnosis of a health related issue of a patient using the model.
  • the image analytic module can use computational statistics to analyse the received medical image data for making a prediction of a likely health related issue.
  • the analytics modules also include a medical treatment module for providing possible medical treatment options for the iden tified health related issue according to the treatment plan datasets .
  • the diagnosis and treatment software program further include a visualization component for receiving a query regarding the health related issue from a user.
  • the diagnosis and treatment software program further includes a chat-bot module for receiving the query from the visualization component. The chat-bot module then provides a response to the query. The response is later transmitted to the user via the visualization component.
  • the chat-bot module can be adapted to process and comprehend the query using natural language processing.
  • the natural lan guage processing refers to a software program, which includes algorithms with an ability to understand human language sen tences or natural language sentences. The algorithms can in terpret key elements of the natural language sentences, and then retrieve relevant information that corresponds to the query from at least one database. The algorithms later build at least one natural language sentence with the retrieved rel evant information for sending it to the user.
  • the query can be provided using either a text message or an audio message.
  • the computer can be provided by a cloud computing system.
  • the cloud computing system comprises a network of computers. These computers provide a significant portion of hardware and soft ware support functions of outsource facility management ser vices .
  • the cloud computing system also allows additional com puting resources to be easily added using techniques, such as load balancing, for handling surges in user demand. Multiple regional computing clusters can also be set-up to support dif ferent regional computing needs.
  • the cloud computing system enables the supporting network computers to be located in an other location that is away from a user with a computing de vice.
  • the computing device of the user can access the cloud computing system via a web application over the Internet.
  • the application also provides a computer media that stores a diagnosis and treatment software program of a personalized healthcare system, which is described above.
  • the computer me dia refers to data storage devices.
  • the application further provides a method for providing per sonalized healthcare for a patient.
  • the method comprises a step of receiving medical image data and corresponding medical diagnoses of different patients, corresponding medical treat ment histories of the different patients, and medical litera ture and a step of integrating the received medical image data and the corresponding medical diagnoses, the received corre sponding medical treatment histories, and the received medical literature to provide treatment plan datasets.
  • the method fur ther includes a step of constructing a model of the medical image data and the corresponding medical diagnoses using a ma chine learning algorithm and a step of providing a possible diagnosis of a health related issue of a patient using the model.
  • the method also includes a step of providing possible medical treatment options for the health related issue accord ing to the treatment plan datasets.
  • the method can further include a step of receiving a query in at least one natural language sentence for identifying a healthcare related issue from a user and a step of processing and comprehending the query using natural language processing.
  • a step of retrieving relevant information that corresponds to the query from at least one database can then be executed.
  • the method further includes a step of building at least one natu ral language sentence with the retrieved relevant information, and a step of sending at least one natural language sentence containing the relevant information to the user.
  • the method can further include a step of selecting a possible medical treatment option that is aligned with an insurance policy of the patient.
  • Fig . 1 illustrates an improved healthcare system for
  • Fig . 2 illustrates a block diagram of a data analytic and modelling software module of a data analytics device of the system of Fig. 1,
  • Fig . 3 illustrates a sandbox testing environment of the data analytic and modelling software module of Fig. 2,
  • Fig . 4 illustrates a flow chart of a method for operating the system of Fig. 1,
  • Fig . 5 illustrates a clinical workflow of diagnosis and treatment of a breast cancer patient, the diagnosis and the treatment being guided by the system of Fig. 1 , and
  • Fig . 6 illustrates a clinical workflow of diagnosis and treatment of a ROP patient, the diagnosis and the treatment being guided by the system of Fig. 1.
  • Fig. 1 shows a block diagram of an improved healthcare system 1.
  • the healthcare system 1 includes a plurality of data sources 10, a data analytics device 3, multiple information visualization devices 7, and a communication network 13.
  • the data analytics device 3 is communicatively connected to the information visualization devices 7 and to the data sources 10 via the communication network 13.
  • the data sources 10 includes a plurality of data bases for storing healthcare related data.
  • the data can be provided in a form of structured data and unstructured data.
  • the data can include text and/or images. Examples of the data include laboratory genomic data, medical prescription notes, clinical case notes, medical images such as mammograms using X-rays and images using ultrasound imaging or magnetic reso nance imaging (MRI), pharmacy data, drug toxicity data, clini cal pathways, and medical literatures.
  • the information visualization devices 7 include smart phones, tablets, laptop computers, and/or computers.
  • the smart phone includes a mobile phone that includes a computer.
  • the mobile phone also has a touchscreen interface, an Internet access, and an operating system capable of running software applica tions .
  • the data analytics device 3 includes a computing processor 31, a memory module 34, and a communication interface 38.
  • the com puting processor 31 is electrically connected to the memory module 34 and to the communication interface 38.
  • the communi cation interface 38 is communicatively connected to the commu nication network 13.
  • the memory module 34 stores an operating system 36 and software applications.
  • the computing processor 31 acts to execute instructions, which are provided by the software applications .
  • the communication network 13 includes the Internet, an intra net, a wide-area network (WAN) , a local area network (LAN) , and/or a wireless network.
  • WAN wide-area network
  • LAN local area network
  • the software applica tions include a data analytic and modelling software module 40, which is shown in Fig. 2.
  • the data analytic and modelling software module 40 includes a data management software compo nent 50, an analytics software component 60, and a visualiza tion software component 70.
  • the data management software com ponent 50 is also called a data management software layer.
  • the analytics software component 60 is also called an analytics software layer.
  • the visualization software component 70 is also called a visualization software layer.
  • the data management software component 50 it in cludes a patient clinical data mart 53 and a research and de velopment data mart 56.
  • the patient clinical data mart 53 includes a medical imaging database, a patient medical prescription database, and a la boratory data genomics database as well as a database to store patient clinical case notes and patient hospitalization rec ords.
  • the medical imaging database can store mammogram images .
  • the research-and-development data mart 56 includes a medical literature database, a drug toxicity database, a clinical pathway database, and knowledge of the crowd database.
  • Each database is provided as one or more collections of data.
  • the database act as a central repository of data, which are received from one or more disparate data sources 10.
  • the data can be provided in multiple data types of different modality and can be in different formats, such as in text and images.
  • the data can also be longitudinal in that it extends over pa tient health history or medical record.
  • the data are often parsed, cleaned, transformed, and harmonized before the data are used.
  • the data can also anonymized, wherein all infor mation for identifying patient are removed from the data to prevent identification of patient.
  • patient clinical data mart 53 and the research and de velopment data mart 56 can be stored in computer servers, cloud instances, personal computers, laptops, and/or portable devices .
  • the analytics software component 60 includes a library comprising a plurality of analytics modules for healthcare and biomedical applications .
  • the analytics modules include a data fusion module 62, an im age module 64, a risk profiling module 66, and a descriptive statistics module 68.
  • the data fusion module 62 is used for gathering multiple heterogeneous data that are extracted from the data bases of the data management software component 50, for inte grating or harmonizing the multiple heterogeneous data, and for storing the harmonized data into the databases.
  • the image module 64 is used for automating assessments or di agnosis of medical images to identify a likely health related issue, such as a disease.
  • the risk profiling module 66 is used for providing patient segmentation and patient risk stratification according to the harmonized data.
  • the descriptive statistics module 68 uses an artificial intel ligence algorithm, such as machine learning, to provide in sights of disease progression of individual patients for im proving patient care.
  • an artificial intel ligence algorithm such as machine learning
  • the descriptive statistics module 68 also provides insights of effectiveness of various treatments to private or public re search organizations, thereby allowing the research organiza tions to streamline or direct their research and development (R&D) activities for improving clinical care.
  • One example of the insight relates to treatment plans for pa tients, wherein the treatment plans are personalized according to a patient profile, patient genome information, diagnostic test results of the patient, and past treatments of similar patients .
  • the visualization software component 70 it in cludes an interactive interface module 73 and a plurality of visualization modules 76.
  • the interactive interface module 73 receives inputs, which are provided from a user to the information visualization device 7.
  • the interface module 73 then transmits the user inputs to the analytics software component 60.
  • the user can refer to a healthcare professional such as a doctor, an oncologist, a ra diologist, and a genomic practitioner, to an insurance pro vider, and to a staff of a pharmaceutical company.
  • the analytics software component 60 then generates information according to the user inputs.
  • the visualization module 76 later receives the generated information from the analytics software component 60 and then displays the generated infor mation on the information visualization device 7 for viewing by the user.
  • the data analytic and modelling software module 40 of the data analytic device 3 is scalable.
  • the data analytic and modelling software module 40 contains components or modules that can be added or removed, thereby allowing for dynamic readjustment and customization of the data analytic and modelling software module 40. Modules or components of the data analytic and modelling software module 40 can change as data and/or data analytics strategy evolve for individual user.
  • a clinical partner wants to incorporate an ad ditional customized database into the data analytics device 3.
  • the data analytics device 3 is configured for management and automated grading of mammograms and for providing patient treatment information.
  • the data analytics device 3 then allows the data management software component 50 to be scaled-up, by including the additional customized database.
  • the modular nature of the data analytic and modelling software module 40 also allows users to add components to the library of analytics modules for enhancing patient care.
  • the compo nents can include customized modules or modules of existing libraries .
  • the data analytic and modelling software module 40 includes a sandbox testing environment 63 for allowing users to test and optimize or im prove solutions or results that are provided by the data ana lytics device 3.
  • the sandbox testing environment 63 provides a computing space for users to add and remove databases, and modules or components for evaluation without affecting other functions of the data analytics device 3.
  • the healthcare system 1 includes a cryptographic security sys tem for meeting security requirements, such as health insur ance portability and accountability act (HIPAA) , and other healthcare industry regulations .
  • HIPAA health insur ance portability and accountability act
  • the cryptographic security system acts to protect data stored in the patient clinical data mart and the research and devel opment data mart of the data management software component 50.
  • database architectures such as non-relational (NoSQL) databases
  • NoSQL non-relational databases
  • the analytics modules are provided with differential privacy and encryption to ensure data security and privacy when performing data analytics .
  • the cryptographic security system acts to protect data/in sights that are being transmitted over the communication net work 13 using various data security features, such as encryp tion protocol.
  • the encryption protocol can refer to Transport Layer Security (TLS) and/or Secure Sockets Layer (SSL) proto cols .
  • the cryptographic security system also provides dedicated ac cess controls for controlling user-rights and for controlling access to different parts of the healthcare system 1, namely the data analytics device 3 and the information visualization devices 7.
  • the cryptographic security system also provides data integrity controls for protecting encryption keys that are used by cryp tographic security system.
  • Real-time security and compliance monitoring are also carried out to detect anomalous activities using security information and event management (SIEM) software products and services like open source security information management (OSSIM) sys tem.
  • SIEM security information and event management
  • OSSIM open source security information management
  • the healthcare system 1 provides several benefits .
  • the healthcare system 1 provides flexibility, scalability, and security.
  • the healthcare system 1 contains compo nents that are modular, thereby allowing users to add and re move components for meeting different needs of the users .
  • the healthcare system 1 is also scalable.
  • the modular nature of the data analytics device 3 also allows dynamic adjustment and customisation of databases, the analytics modules, and/or the visualization modules according to changing need of the user. The user can add or remove any components that are provided in the data analytics device 3 as and when they need.
  • the healthcare system 1 is also secure for preventing unauthorised access of the healthcare system 1.
  • the data sources 10 can also include patient medical databases of multiple healthcare service providers, wherein the healthcare service providers collaborate with insurance pro viders to provide medical services for insured persons who have purchased travel insurance policies from their respective insurance providers .
  • These insured persons can provide consent to allow the im proved healthcare system 1 to retrieve their medical infor mation from the databases of these healthcare service provid ers when the travel insurance policies of the insured persons are in force .
  • the insured person or his family member can no tify his insurance provider.
  • the insurance provider can then request the improved healthcare system 1 to retrieve medical records of the corresponding insured person from his
  • This arrangement allows the overseas healthcare service pro vider to obtain relevant medical information quickly, thereby avoiding unnecessary medical tests, which are needed to treat the patient. This can then save time and cost in treating the insured person.
  • Fig. 4 shows a flow chart 80 of a method of providing an on cology healthcare to a patient, which uses machine learning technologies to process large patient data relating to breast cancer for diagnosing possible breast cancer progression of the patient and for providing possible personalized treatments for the patient.
  • the flow chart 80 includes a step 82 of providing possible di agnosis .
  • the computing processor 31 executes instructions to gather different medical diagnostic images of human breasts with corresponding diagnosis of various patients from a plu rality of clinics, hospitals, and medical institutions or health statutory organizations, in a step 84.
  • the medical diagnostic images include mammograms, ultrasound im ages, and MRI images.
  • the computing processor 31 executes instructions of an algorithm of a data fusion module for integrating the above-mentioned data to form human breast image datasets with a predetermined data structure, in a step 86.
  • the computing processor 31 executes in structions to augment the human breast image datasets by gen erating additional image datasets.
  • the data augmentation includes scaling and rotation of the medical diag nostic images of human breasts .
  • the computing processor 31 then executes instructions to con struct a breast cancer image diagnostic model from the human breast image datasets with corresponding diagnosis using ma chine learning techniques, in a step 90.
  • the image diagnostic model can be later used to provide a sug gested diagnosis of a medical diagnostic image of a new pa tient.
  • the suggested diagnosis can relate to possible identi fication of breast tumours as well as possible growth stage of the breast tumours.
  • the suggested diagnosis is later stored in one or more databases of the oncology healthcare system 1. Following this, a step 92 of providing possible treatments is performed .
  • the computing processor 31 executes instructions of an algorithm of a data fusion module for gathering various medical image diagnoses, liquid biopsy test results, breast biopsy pathology reports, and patient case histories of vari ous patients with various profiles from various clinics, hos pitals, and medical institutions or health statutory organiza tions, in a step 94.
  • the patient case histories include treat ments received by the patients .
  • the data from various medical publications relating to breast cancer can also be integrated into the human breast treatment datasets.
  • the medical publications include medical literatures and medical care standards or treatment guidelines.
  • the treatment datasets can later be used to provide possible treatment plans for a new patient, in a step 98, wherein each possible treatment plan is personalized or customized for the new patient according to medical history and test results of other patients with profile similar to the new patient and ac cording to relevant medical literature.
  • the possible treatment plans are then stored in one or more databases of the oncology healthcare system 1.
  • the oncology healthcare system 1 can further include a chat bot module, which is provided in an analytics software compo nent 60 of the oncology healthcare system 1.
  • the chat-bot mod ule refers to a software program that provides a method for providing a conversation between the oncology healthcare sys tem 1 and a user.
  • a user provides a query in the form of one or more natural language sentences to a chat-bot interface of an in formation visualization device 7.
  • the sentences can be in a text format or an audio format .
  • An interactive interface module 73 of a visualization software component 70 then receives the query and later sends to the chat-bot module.
  • the chat-bot module afterward receives the query and then pro Completes and comprehends the query using natural language pro cessing techniques.
  • the chat-bot module builds one or more natural language sentences with the relevant information in a text format or an audio format.
  • the natural language sentences that contain the relevant in formation are later sent to the user.
  • the chat-bot module is configured to interface with databases, which store medical information of various patients, for access by clinicians only.
  • This clini cian chat-bot module can allow a doctor to issue a query about the patient to retrieve medical information of a patient eas ily for display on his information visualization device 7 when the doctor delivers healthcare services to the patient at a point of care.
  • This clinician chat-bot module can also allow, for an example, an oncologist to order a targeted therapy drug for a cancer patient using natural language sentence request. This will make the drug ordering process efficient and simple, thereby removing barriers that may hinder the oncologist from procuring the targeted therapy drug.
  • the chat-bot module is configured to interface with databases, which store, for examples, pa tient treatment plans and information relating to nutrition and lifestyle guidance for patients to access.
  • This patient chat-bot module can allow patients retrieve their respective treatment plans for viewing.
  • the patients can also receive nu trition and lifestyle guidance for improving their health.
  • the patients can also provide feedback about their treatment progresses, to their respective doctors, via a chat-bot interface.
  • the oncology healthcare system 1 is also configured to provide clinical workflow steps for diagnosis and treatment of the breast cancer, which are described below.
  • Fig. 5 shows a clinical workflow 100 of diagnosis and treat ment for a breast cancer patient, wherein the oncology healthcare system 1 is used to provide possible diagnoses and possible treatments .
  • the workflow 100 shows a first step 110 of a patient detecting a breast lump during a physical or medical examination or de tecting indications of cancer cells in a blood sample during a regular liquid biopsy screening.
  • the patient then consults with a physician, in a step 120.
  • the physician later inputs a query to the oncology healthcare system 1, via an information visualization device 7, to re trieve electronic medical records of the patient.
  • a next step 130 the physician uses the retrieved medical records to assist him to provide a clinical assessment of the patient .
  • the physician then updates the patient electronic medical rec ords in the oncology healthcare system 1 with his clinical as sessment of the patient.
  • the oncology healthcare system 1 afterward analyses the clini cal assessment and suggests that the patient undergoes a mam mogram, in a step 140.
  • the oncology healthcare system 1 also identifies possible clinics that can provide mammography ser vices with their corresponding waiting periods.
  • a radiologist of the selected clinic then performs a mammogram for the patient and later stores images of the mammogram in the databases of the oncology healthcare system 1.
  • the oncology healthcare system 1 analyses the mammogram images using the image diagnostic model to provide possible diagnosis.
  • the diagnosis can include a recommendation for further diagnostic tests, such as an ultra sound scan or a MRI scan.
  • the diagnosis can also include a recommendation for a breast biopsy.
  • the radiologist reviews the mammogram images and the possible diagnosis, which is generated by the oncology healthcare system 1.
  • the radiologist then provides a final di agnosis of the mammogram images.
  • the possible diagnosis acts to assist and guide the radiologist to provide the final diag nosis, wherein the radiologist decides whether to take up these suggestions .
  • the oncology healthcare system 1 also identifies clinics that can perform the further diagnostic tests and also allows a staff to arrange appointments with the selected clinics for the patient.
  • the oncology healthcare system 1 later performs a diagnosis of the patient regarding disease progression based on the diag nostic test results .
  • the oncology healthcare system 1 also suggests next diagnostic steps according to the human breast treatment datasets and also identifies possible medical oncologists for the patient, accord to the patient profile and past medical case history of the patient. The physician later selects a medical oncologist who emphasizes in breast cancer for the patient, in a step 160.
  • a next step 170 the selected medical oncologist reviews the possible treatment plans and selects next steps, such as obtaining metastases scan on high risk body areas, obtaining a multiplex i munohistochemistry scan, and/or performing genome testing for obtaining patient genomic sequencing.
  • Results of the scan and of the genome testing are afterward transmitted to the oncology healthcare system 1 for storing in respective case files of the patient.
  • the healthcare system 1 then generates possible treatment plans, according to the stored date, using the treatment da tasets, for the medical oncologist to review, in a step 180.
  • the treatment plans are personalized or customized according to the scan results and to the genome testing results together with other patient test results and with other patient related data, such as the patient profile and patient past medical case history.
  • the treatment plans are also formulated accord ing to clinical literature, medical guidelines, and/or past treatments of other similar patients, for producing the best outcomes.
  • the treatment plans may include lumpectomy or mas tectomy, chemotherapy, radiotherapy, and hormone therapy.
  • the medical oncologist then reviews the possible personalized treatment plans with supporting medical evidences and with in surance coverage of the patient, which are provided the healthcare system 1.
  • the medical oncologist can later discuss the possible person alized treatment plans with the patient and then select a treatment plan that is aligned with the patient insurance cov erage .
  • the medical oncologist can also use the oncology healthcare system 1 to arrange schedules for performing liquid biopsy tests and/or breast biopsies for monitoring the patient's response to the treatments .
  • Results of the liquid biopsy tests and pathology reports of the breast biopsies are also stored in the oncology healthcare system 1 to assess disease progression and response of the pa tient to the treatments performed so far.
  • the oncology healthcare system 1 later generates an analysis of these test results and these pathology reports .
  • the oncology healthcare system 1 may suggest changes to the treatment plan, if any, based on the assessment. For an exam ple, the system may select and recommend a clinical trial op tion for the patient.
  • the medical oncologist then reviews the suggested changes to the treatment plan and can adjust the treatment plan accord ingly .
  • Healthcare professionals such as nurses, can also use the on cology healthcare system 1 to discuss scheduling of the treat ment with the patient to optimise or improve the treatment schedules .
  • the oncology healthcare system 1 can also automatically place orders of required drugs and medical services ahead of sched ule .
  • the medical oncologist can schedule the patient for follow-up monitoring, which can extend over several years, in a step 190.
  • the patient can be subjected to annual mammography, clinical review every 3 to 6 months for a period of 5 years, monthly breast self-examination, and nutrition and lifestyle guidance.
  • the oncology healthcare system 1 can also monitor the follow up monitoring and issue automated reminders to the patient re garding the follow-up monitoring.
  • the oncology healthcare system 1 can also provide nutrition and lifestyle guidance to the patient based on analysis of case histories of similar patient profiles.
  • the outcome of the follow-up monitoring is later stored in the databases of the healthcare system 1 to allow the oncologist or his staff to monitor and track the health condition of the patient .
  • the oncology healthcare system 1 provides several features .
  • the oncology healthcare system 1 is patient-cen tric, being directed to provide best or improved treatment outcome for the patient.
  • the oncology healthcare system 1 pro vides treatment plan options that are data-backed for a pa tient to select a treatment plan that is targeted or custom ized to suit the patient.
  • the patient can then choose the treatment plan according to cost, namely patient financial ability and patient insurance plan.
  • the patient can then have higher trust in their clinicians and in treatment and recovery processes.
  • the patients can also recover faster with fewer complications, allowing the patient to resume their former life activity.
  • the oncology healthcare system 1 provides a pa tient-specific decision support.
  • the decision support provides doctors with patient-specific information that is integrated and analyzed for presenting at a point of care so that the doctors can deliver consistent and high-quality cancer care.
  • the oncology healthcare system 1 also provides possible analy sis with possible treatments for doctors to view in order to produce the best possible outcome for patients with similar profiles and for doctors to adopt best practices.
  • the oncology healthcare system 1 also provides consistent clinical workflow for doctors .
  • the oncology healthcare system 1 also can enable the doctors to treat their patients faster, and at lower cost, which con tributes to their job satisfaction and also to enhance their reputation .
  • the oncology healthcare system 1 also enables the doctors to view respective tier of insurance plan of the patients, so that they can discuss various treatment plans and correspond ing costs with the patients for aligning with their insurance plans .
  • the oncology healthcare system 1 can also be further adapted to inform the about this, in order to enroll patients in the respective patient financial assistance programs. This not only eases the financial burden of the pa tients, but also saves time in the enrollment process.
  • the oncology healthcare system 1 allows doctors to be more efficient so that they can join a pool of doctors who are approved by insurance providers .
  • the oncology healthcare system 1 also helps doctors to contact with other approved doctors for discussing about further treatment plans of their patient. In effect, the healthcare system 1 acts to enlarge the network of the doctors and also provides the doctors with a list of approved doctors who are suitable for their patients.
  • the oncology healthcare system 1 al lows insurance providers to have a pool of doctors partnering and collaborating with the insurance providers.
  • the oncology healthcare system 1 can also enable the insurance providers to rank these collaborating doctors.
  • the oncology healthcare system 1 is able, over a period of time, to gather statistics regarding costs and effectiveness, as well as other parameters of these collaborating doctors.
  • the cost can relate to number of claims and to claim amount of each patient of each of the collaborating doctor.
  • the insurance providers can then remove least effective or most expensive doctors from the pool of the collaborating doc tors, thereby reducing an overall number of claims and reduc ing the amount of the claims, which in turn lowers cost of in surance and reduces processing time of claims.
  • the oncology healthcare system 1 can also allow the insurance providers to formulate new insurance products with new pricing models, such as offering new personalized in surance products that can be aligned to health risk profile of a person.
  • Fig. 6 shows a flow chart 200 of a method for diagnosing pos sible ROP using this eye vision healthcare system 1.
  • the improved healthcare system 1 is configured to pro vide a method for eye vision care using machine learning tech nologies to process video images of babies' eyes for diagnos ing possible retinopathy of prematurity (ROP) and identifica tion of a possible stage of ROP.
  • ROP retinopathy of prematurity
  • Retinopathy of prematurity is an eye illness that happens to premature babies.
  • the premature babies refer to babies being born after a gestation of around 36 to 37 weeks or shorter. A normal pregnancy lasts for about 40 weeks. Consequently, the premature babies have less time to develop in the womb of their mothers, causing them to be more susceptible to health complications and defects.
  • Some of the problems that may af fect the premature babies include vision and hearing impair ment. This is because final stages of vision and hearing de velopment of the baby occur in last few weeks of pregnancy.
  • Oxygen therapy is often used due to premature develop ment of the babies' lungs. However, this may result in disease of the eye. It is thought that such disease is caused by dis organized growth of retinal blood vessels. The retina may be come damaged if abnormal blood vessels begin to swell and to leak blood. When this happens, the retina can detach from the eyeball, leading to a vision impairment.
  • the retinopathy of prematurity comprises 5 stages.
  • stage 1 an affected eye shows a demarcation line.
  • stage 2 the de marcation line has a ridge and/or popcorn appearing on the ridge.
  • stage 3 new blood vessels - neovascularization - are developed on the demarcation line and this can lead to ex tra-retinal proliferation of tissue.
  • the ridge may bleed and cause traction on the ridge.
  • the stage 3 is a critical stage in development of ROP as it signifies that retinal ischaemia is significant enough to cause development of new vessels for supplying oxygen to the retina.
  • retinal vessels are not there in the avascular retina in the periphery, the new vessels grow in a futile attempt to try to re-vascularise the area.
  • stage 4 retinal detachment starts to occur due to the traction of the fibrous and vascular tissue over the ridge.
  • the stage 4 includes a stage 4A, wherein the retina, without its macula, detaches from the eyeball and a stage 4B, wherein the retina with its macula detach from the eyeball.
  • stage 5 which is the final stage of ROP, the retina com pletely detaches from the eyeball, causing vision impairment.
  • ROP can be mild and may resolve spontaneously. But it can also lead to blindness in serious cases. ROP can also cause other complications later in life of the baby. Examples of these complications include crossed eyes, near-sightedness, far sightedness, lazy eye, and glaucoma. It is hence important to screen infants for ROP.
  • ROP can be screened or diagnosed by ophthalmologic examina tion.
  • the ophthalmologic examination can be done using a bin ocular indirect ophthalmoscopy (BIO) . This method, however, often does not permit adequate assessment of ROP in retinal periphery. Moreover, appropriate pain-relieving steps, such as local anaesthetic eye drop and oral sucrose, need be used.
  • the ophthalmologic examination can also be performed using a retcam, which refers to a wide angle digital paediatric reti nal imaging equipment. This method avoids stress and expertise of BIO examination and indentation but is as specific and sen sitive as BIO. This method is useful for diagnosis and tele medicine .
  • the ophthalmologic examination is often labour intensive, and the examination procedure is also often uncomfortable for the premature babies. Unlike adults who can receive doctor's in struction and act accordingly when they receive ophthalmologic examination using an ophthalmoscopy test to see inside of the eye, the premature babies are often active and cannot act ac cording to doctor's instructions. Furthermore, light is not suitable to be shone directly into their eyes, as this can lead to possible blindness.
  • the improved healthcare system 1 for eye vision care can re Jerusalem dependence on skilled medical personnel for ROP screening and for reducing their workload. This can address a problem of the number of trained doctors being insufficient to take care of the many babies in various developing and under developed countries.
  • the use of the eye vision care system can also shorten the time for detecting the ROP symptoms to allow doc tors performing treatment on patients early.
  • the method includes a first step 210 of a computing processor 31 executing instructions to gather different human eye raw image data, which includes ROP image data with corresponding diagnosis that include ROP stage data, from a plurality of clinics, hospitals, and medical institutions.
  • the human eye raw image data can include digital and/or video eye images that show eye features, such as eye demarcation line, eye de marcation line with ridge, popcorn appearance on the ridge, ridge with extraretinal proliferation, and partial or total retinal detachment.
  • the computing processor 31 then executes instructions of an algorithm of a data fusion module for integrating the eye raw image data to form eye datasets, in a step 220.
  • the computing processor 31 later executes instructions to aug ment the eye datasets by generating additional eye datasets, in a step 230.
  • the computing processor 31 then executes instructions to con struct a ROP model from the eye dataset, using a machine learning algorithm, in a step 240.
  • This ROP model can later be used for providing a suggested di agnosis of eye video images of a new baby.
  • the suggested diag nosis can also include identification of ROP as well as stage of the ROP.
  • the improved healthcare system 1 for eye vision care can also include a chat-bot module for providing a conversation between the improved healthcare system 1 and a user.
  • This chat-bot module is similar to the chat-bot module of the oncology healthcare system 1, which is described above.
  • the improved healthcare system 1 can also be configured to provide possible diagnosis and possible treatment of other health related issues, such as diabetes, wherein the possible treatment can include personalized diet plans for diabetes patients.
  • the improved healthcare system 1 provides compo nents that are modular for allowing users to add and remove components for meeting different needs of the users. This also allows dynamic adjustment and customisation of databases, the analytics modules, and/or the visualization modules according to changing need of the user.
  • a personalized healthcare system comprising a computer, the computer comprising
  • a communication interface for receiving medical image data and corresponding medical diagnoses of different patients, corresponding medical treatment histories of the different patients, and medical literature, and
  • a computing processor for executing instruc tions of a diagnosis and treatment software program, the diagnosis and treatment software program comprising
  • a data management component comprising a plurality of databases for storing the medical image data and the corresponding medical diagnoses, the corresponding medi cal treatment histories, and the medical literature ,
  • an analytics component comprising a plu rality of modular analytics modules, the plurality of modular analytics modules comprising
  • a data fusion module for integrating the medical image data, the corre sponding medical diagnoses, the cor responding medical treatment histo ries, and the medical literature to provide treatment plan datasets
  • an image analytic module for con structing a model of the medical im age data and the corresponding medi cal diagnoses using a machine learn ing algorithm and for providing a possible diagnosis of a health re lated issue of a patient using the model ,
  • a medical treatment module for providing possible medical treatment options for the health related issue according to the treatment plan da tasets
  • a visualization component for receiving a query regarding the health related issue from a user, wherein the diagnosis and treatment software program fur ther comprises a chat-bot module for receiving the query and for providing a response to the query for transmit ting to the user via the visualization component.
  • the chat-bot module is adapted to process and comprehend the query using natural language processing, to retrieve relevant information that corresponds to the query from at least one database, and to build at least one natural language sentence with the retrieved relevant information for sending it to the user.
  • the query is provided using a text message.
  • the personalized healthcare system according to one of items 1 to 4, wherein the computer is provided by a cloud computing system.
  • a computer media storing a diagnosis and treatment soft ware program of a personalized healthcare system of one of items 1 to 4.
  • a method for providing personalized healthcare for a pa tient comprising

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Surgery (AREA)
  • Urology & Nephrology (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

L'invention concerne un système de soins de santé personnalisé comprenant un ordinateur. L'ordinateur comprend une interface de communication pour recevoir des données, qui comprennent des données d'image médicale et des diagnostics médicaux correspondants, des historiques de traitement médical correspondants, et des documents médicaux. L'ordinateur comprend également un processeur informatique pour exécuter des instructions d'un programme logiciel pour intégrer les données reçues afin de fournir des ensembles de données de plan de traitement, de construire un modèle des données d'image médicale et des diagnostics médicaux correspondants à l'aide d'un algorithme d'apprentissage automatique, de fournir un diagnostic possible d'un problème lié à la santé d'un patient à l'aide du modèle, et de fournir des options de traitement médical possibles pour le problème lié à la santé selon les ensembles de données de plan de traitement.
PCT/IB2018/052161 2018-02-12 2018-03-29 Plateforme d'intelligence artificielle de technologie médicale intégrative WO2019155267A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB1802221.0A GB201802221D0 (en) 2018-02-12 2018-02-12 Integrative medical technology artificial intelligence platform
GB1802221.0 2018-02-12

Publications (1)

Publication Number Publication Date
WO2019155267A1 true WO2019155267A1 (fr) 2019-08-15

Family

ID=61731406

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2018/052161 WO2019155267A1 (fr) 2018-02-12 2018-03-29 Plateforme d'intelligence artificielle de technologie médicale intégrative

Country Status (2)

Country Link
GB (1) GB201802221D0 (fr)
WO (1) WO2019155267A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111696675A (zh) * 2020-05-22 2020-09-22 平安国际智慧城市科技股份有限公司 基于物联网数据的用户数据分类方法、装置及计算机设备
US10936962B1 (en) 2019-11-01 2021-03-02 Kenneth Neumann Methods and systems for confirming an advisory interaction with an artificial intelligence platform
CN113450905A (zh) * 2020-03-24 2021-09-28 株式会社理光 医疗辅助诊断系统、方法及计算机可读存储介质
CN113840006A (zh) * 2021-09-27 2021-12-24 平安国际智慧城市科技股份有限公司 问诊接口的管理方法、装置、电子设备以及存储介质
WO2022174491A1 (fr) * 2021-02-19 2022-08-25 平安科技（深圳）有限公司 Procédé et appareil fondés sur l'intelligence artificielle pour le contrôle qualité des dossiers médicaux, dispositif informatique et support de stockage
WO2022185199A1 (fr) * 2021-03-04 2022-09-09 Serenus Ai Ltd. Procédé et système automatisés de prédiction d'efficacité de traitements

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090313041A1 (en) * 2002-12-10 2009-12-17 Jeffrey Scott Eder Personalized modeling system
US20130179820A1 (en) * 2010-08-31 2013-07-11 Fujifilm Corporation Medical information display apparatus, method, and program
US20150213234A1 (en) * 2014-01-24 2015-07-30 Thomas Dorsett Predictive Patient to Medical Treatment Matching System and Method
CN105760705A (zh) * 2016-05-20 2016-07-13 陕西科技大学 一种基于大数据的医疗诊断系统
US20170177814A1 (en) * 2015-12-21 2017-06-22 International Business Machines Corporation Machine training and search engine for providing specialized cognitive healthcare apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090313041A1 (en) * 2002-12-10 2009-12-17 Jeffrey Scott Eder Personalized modeling system
US20130179820A1 (en) * 2010-08-31 2013-07-11 Fujifilm Corporation Medical information display apparatus, method, and program
US20150213234A1 (en) * 2014-01-24 2015-07-30 Thomas Dorsett Predictive Patient to Medical Treatment Matching System and Method
US20170177814A1 (en) * 2015-12-21 2017-06-22 International Business Machines Corporation Machine training and search engine for providing specialized cognitive healthcare apparatus
CN105760705A (zh) * 2016-05-20 2016-07-13 陕西科技大学 一种基于大数据的医疗诊断系统

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10936962B1 (en) 2019-11-01 2021-03-02 Kenneth Neumann Methods and systems for confirming an advisory interaction with an artificial intelligence platform
CN113450905A (zh) * 2020-03-24 2021-09-28 株式会社理光 医疗辅助诊断系统、方法及计算机可读存储介质
CN111696675A (zh) * 2020-05-22 2020-09-22 平安国际智慧城市科技股份有限公司 基于物联网数据的用户数据分类方法、装置及计算机设备
CN111696675B (zh) * 2020-05-22 2023-09-19 深圳赛安特技术服务有限公司 基于物联网数据的用户数据分类方法、装置及计算机设备
WO2022174491A1 (fr) * 2021-02-19 2022-08-25 平安科技（深圳）有限公司 Procédé et appareil fondés sur l'intelligence artificielle pour le contrôle qualité des dossiers médicaux, dispositif informatique et support de stockage
WO2022185199A1 (fr) * 2021-03-04 2022-09-09 Serenus Ai Ltd. Procédé et système automatisés de prédiction d'efficacité de traitements
CN113840006A (zh) * 2021-09-27 2021-12-24 平安国际智慧城市科技股份有限公司 问诊接口的管理方法、装置、电子设备以及存储介质
CN113840006B (zh) * 2021-09-27 2023-07-11 深圳平安智慧医健科技有限公司 问诊接口的管理方法、装置、电子设备以及存储介质

Also Published As

Publication number Publication date
GB201802221D0 (en) 2018-03-28

Similar Documents

Publication Publication Date Title
WO2019155267A1 (fr) Plateforme d'intelligence artificielle de technologie médicale intégrative
Tursunbayeva et al. Artificial intelligence in health‐care: implications for the job design of healthcare professionals
Fiske et al. The double-edged sword of digital self-care: Physician perspectives from Northern Germany
US20120221251A1 (en) Systems and methods for selecting, ordering, scheduling, administering, storing, interpreting and transmitting a plurality of psychological, neurobehavioral and neurobiological tests
US20110093295A1 (en) Consumer enabling system for personalized health maintenance
US20140155763A1 (en) Medical analysis and diagnostic system
JPWO2005122033A1 (ja) 医療総合情報装置及び医療総合情報システム
US20170293988A1 (en) Systems and methods for obtaining and displaying medical data to assist decision making during a medical emergency
Wilson et al. Mapping the Potential of eHealth: Empowering the Citizen through eHealth Tools and Services. Research Report presented at the eHealth Conference, Cork, Ireland, 5-6 May 2004
Chang et al. The impact of an mHealth app on knowledge, skills and anxiety about dressing changes: A randomized controlled trial
US11200967B1 (en) Medical patient synergistic treatment application
Rogers Internet of things-based smart healthcare systems, wireless connected devices, and body sensor networks in COVID-19 remote patient monitoring
WO2019162789A1 (fr) Modification dynamique d'une image
WO2019136137A1 (fr) Système et procédé pour service de soins de santé automatisés
US20160232304A1 (en) Systems and methods for obtaining and displaying medical data to assist decision making during a medical emergency
Houlton How artificial intelligence is transforming healthcare
Walters et al. Virtualized care systems, medical artificial intelligence, and real-time clinical monitoring in COVID-19 diagnosis, screening, surveillance, and prevention
Maka et al. The validity of telemedicine-based screening for retinopathy of prematurity in the Premature Eye Rescue Program in Hungary
US20210225498A1 (en) Healthcare workflows that bridge healthcare venues
US20140129257A1 (en) Diagnostic selection, triage, monitoring, and patient care management of critical care patients using computer-driven assessment
Israni et al. Human‐Machine Interaction in Leveraging the Concept of Telemedicine
Harper et al. Incorporating patient satisfaction metrics in assessing multidisciplinary breast cancer care quality
Uma Potential Integration of Artificial Intelligence and Biomedical Research Applications: Inevitable Disruptive Technologies for Prospective Healthcare
KR20230115719A (ko) 원격 협진 시스템 및 방법
Manukova et al. Innovative Concept of Application of Electronic Modeling in Building e-Health Systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18905886

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18905886

Country of ref document: EP

Kind code of ref document: A1