WO2019196286A1 - 疾病预测方法及装置、计算机装置及可读存储介质 - Google Patents
疾病预测方法及装置、计算机装置及可读存储介质 Download PDFInfo
- Publication number
- WO2019196286A1 WO2019196286A1 PCT/CN2018/099847 CN2018099847W WO2019196286A1 WO 2019196286 A1 WO2019196286 A1 WO 2019196286A1 CN 2018099847 W CN2018099847 W CN 2018099847W WO 2019196286 A1 WO2019196286 A1 WO 2019196286A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- weather
- disease
- layer
- disease monitoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/80—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for detecting, monitoring or modelling epidemics or pandemics, e.g. flu
Definitions
- the present application relates to the field of prediction technologies, and in particular, to a disease prediction method and apparatus, a computer apparatus, and a non-volatile readable storage medium.
- disease prediction An important task in the early warning of public health emergencies is disease prediction, which predicts future disease surveillance data based on historical disease surveillance data (ie, patient data).
- disease prediction With the development of machine learning technology, more and more machine learning methods are applied to disease prediction.
- traditional machine learning applied to disease prediction often requires artificially defining feature sets, and then searching for the best feature combinations from the defined feature sets, and the effects are often not good enough, thus affecting the accuracy of disease prediction.
- a first aspect of the present application provides a disease prediction method, the method comprising:
- the lyric data is time-series data corresponding to the disease monitoring data; pre-processing the disease monitoring data, weather data and public opinion data; constructing a multi-layer long-term memory recurrent neural network model, ie more a layered LSTM model; obtaining training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and training and verifying the multi-layer LSTM model using the training data and the verification data
- Obtaining an optimized multi-layer LSTM model obtaining disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, before the predicted time point Disease monitoring data, weather data and public opinion data are entered into the optimized
- the multi-layer LSTM model obtains disease prediction results at the predicted time points.
- a second aspect of the present application provides a disease prediction apparatus, the apparatus comprising:
- a first acquiring unit configured to acquire disease monitoring data, where the disease monitoring data is time series data
- a second acquiring unit configured to acquire weather data related to the disease monitoring data, where the weather data is time series data corresponding to the disease monitoring data;
- a third obtaining unit configured to acquire public opinion data related to the disease monitoring data, where the public opinion data is time series data corresponding to the disease monitoring data;
- a pre-processing unit for pre-processing the disease monitoring data, weather data, and public opinion data
- a building unit for constructing a multi-layer long-term memory recurrent neural network model that is, a multi-layer LSTM model
- An optimization unit configured to acquire training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and use the training data and the verification data to train and perform performance on the multi-layer LSTM model Verify that the optimized multi-layer LSTM model is obtained;
- a prediction unit configured to obtain disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, and the disease monitoring data before the predicted time point,
- the weather data and the public opinion data are input into the optimized multi-layer LSTM model to obtain the disease prediction result at the predicted time point.
- a third aspect of the present application provides a computer apparatus comprising a memory and a processor, the memory for storing at least one computer readable instruction, the processor for executing the at least one computer readable instruction Implement the following steps:
- disease monitoring data wherein the disease monitoring data is time series data; acquiring weather data related to the disease monitoring data, the weather data is time series data corresponding to the disease monitoring data; and acquiring the disease monitoring data
- the lyric data is time-series data corresponding to the disease monitoring data; pre-processing the disease monitoring data, weather data and public opinion data; constructing a multi-layer long-term memory recurrent neural network model, ie more a layered LSTM model; obtaining training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and training and verifying the multi-layer LSTM model using the training data and the verification data
- Obtaining an optimized multi-layer LSTM model obtaining disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, before the predicted time point Disease monitoring data, weather data and public opinion data are entered into the optimized LSTM layer model, to obtain a prediction result predicted disease point of time.
- a fourth aspect of the present application provides a non-volatile readable storage medium storing at least one computer readable instruction when executed by a processor Implement the following steps:
- the lyric data is time-series data corresponding to the disease monitoring data; pre-processing the disease monitoring data, weather data and public opinion data; constructing a multi-layer long-term memory recurrent neural network model, ie more a layered LSTM model; obtaining training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and training and verifying the multi-layer LSTM model using the training data and the verification data
- Obtaining an optimized multi-layer LSTM model obtaining disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, before the predicted time point Disease monitoring data, weather data and public opinion data are entered into the optimized
- the multi-layer LSTM model obtains disease prediction results at the predicted time points.
- the present application acquires disease monitoring data, which is time-series data; acquires weather data related to the disease monitoring data, the weather data is time-series data corresponding to the disease monitoring data; and acquiring the disease monitoring Data-related public opinion data, wherein the public opinion data is time-series data corresponding to the disease monitoring data; pre-processing the disease monitoring data, weather data, and public opinion data; constructing a multi-layer long-term memory recurrent neural network model, a multi-layer LSTM model; obtaining training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and training the multi-layer LSTM model using the training data and the verification data Performance verification, obtaining an optimized multi-layer LSTM model; obtaining disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, and predicting the predicted time Enter the disease monitoring data, weather data and public opinion data before the point After LSTM multilayer model, the prediction result obtained disease predicted
- This application predicts disease data using a multi-layer LSTM model.
- the LSTM model can extract knowledge directly from the data, construct a feature vector that is favorable for prediction, and improve the prediction accuracy.
- the LSTM model solves the problem of long-term dependent time gradient disappearance caused by excessive time series data.
- the present application adds weather data and public opinion data as influencing factors to the disease prediction, thereby improving the accuracy of disease prediction. Therefore, the present application achieves a high accuracy rate of disease prediction.
- FIG. 1 is a flowchart of a disease prediction method according to Embodiment 1 of the present application.
- FIG. 2 is a detailed flowchart of acquiring weather data related to disease monitoring data in the disease prediction method provided in the second embodiment of the present application.
- FIG. 3 is a structural diagram of a disease prediction apparatus according to Embodiment 3 of the present application.
- FIG. 4 is a detailed structural diagram of a second acquiring unit of the disease prediction apparatus according to Embodiment 4 of the present application.
- FIG. 5 is a schematic diagram of a computer device according to Embodiment 5 of the present application.
- the disease prediction method of the present application is applied to one or more computer devices.
- the computer device is a device capable of automatically performing numerical calculation and/or information processing according to an instruction set or stored in advance, and the hardware thereof includes but is not limited to a microprocessor and an application specific integrated circuit (ASIC). , Field-Programmable Gate Array (FPGA), Digital Signal Processor (DSP), embedded devices, etc.
- ASIC application specific integrated circuit
- FPGA Field-Programmable Gate Array
- DSP Digital Signal Processor
- embedded devices etc.
- FIG. 1 is a flowchart of a disease prediction method according to Embodiment 1 of the present application.
- the disease prediction method is applied to a computer device.
- the disease prediction method predicts disease monitoring data by using a long-term memory recurrent neural network model to obtain a high-accuracy disease prediction result.
- the disease prediction method specifically includes the following steps:
- step 101 disease monitoring data is acquired, and the disease monitoring data is time series data.
- the disease monitoring data may include disease data for diseases such as influenza, hand, foot and mouth disease, measles, and mumps.
- a disease monitoring network composed of a plurality of monitoring points may be established in a preset area (for example, a province, a city, a region), and disease monitoring data is acquired from the monitoring points, and the disease monitoring data constitutes time series data of disease monitoring.
- Medical institutions, schools, child care institutions, pharmacies, etc. can be selected as monitoring points to conduct disease monitoring and data collection for the corresponding target population.
- a place that meets the preset conditions can be selected as the monitoring point.
- the preset condition may include a number of people, a scale, and the like. For example, select a school with a predetermined number of schools and child care institutions as monitoring points. Another example is to select a pharmacy that has reached the preset size (for example, by daily turnover) as a monitoring point. For another example, select a hospital (for example, the number of people who seek medical treatment in Japan) to reach a preset size as a monitoring point.
- Disease monitoring data at different times constitute time series data for disease surveillance.
- disease monitoring data collected on a daily basis can be used to form time series data for disease surveillance.
- the disease monitoring data collected on a weekly basis may constitute time series data for disease monitoring.
- Medical institutions (mainly including hospitals) are the best place to capture early warning signs of disease and are the first choice for disease surveillance.
- Disease surveillance data can be obtained based on patient visits.
- the disease monitoring data can be obtained according to the drug sales of the pharmacy.
- the medical institution, the school, the child care institution, and the pharmacy are mainly selected for the collection of disease monitoring data.
- the above selection of data sources does not limit the addition or replacement of other focused populations or sites in other embodiments as a source of data for monitoring.
- hotels can be included in the disease surveillance area to obtain disease surveillance data for hotel residents.
- the disease monitoring data collected by any type of monitoring point can constitute time series data of disease monitoring.
- the disease monitoring data collected by the hospital can be taken to constitute time series data of disease monitoring.
- the disease monitoring data collected by the plurality of types of monitoring points can be combined to form time series data of disease monitoring.
- the disease monitoring data collected by the hospital can be mainly used, supplemented by the disease monitoring data participated by the pharmacy, and constitute time series data of disease monitoring.
- the disease monitoring data may include disease data such as the number of visits to the disease, the rate of visits, the number of cases, and the incidence rate.
- disease data such as the number of visits to the disease, the rate of visits, the number of cases, and the incidence rate.
- the number of daily visits to a disease eg, flu
- a medical institution eg, a hospital
- the number of daily visits of the disease eg, flu
- the number of daily illnesses of a student's disease e.g., flu
- the number of illnesses per day of the disease e.g., flu
- Step 102 Acquire weather data related to the disease monitoring data, where the weather data is time series data corresponding to the disease monitoring data.
- Weather data related to disease surveillance data refers to weather data that affect disease surveillance data (ie disease disease data).
- the influence of different weather data on the disease monitoring data may be analyzed in advance, and weather data having influence or influence on the disease monitoring data may be determined according to the analysis result.
- the weather data may include humidity, temperature, air pressure, precipitation, water vapor pressure, wind speed, wind direction, and sunshine hours.
- the weather data may include daily average temperature, average air pressure, maximum temperature, minimum temperature, average relative humidity, minimum relative humidity, precipitation, average wind speed, sunshine hours, and average water vapor pressure.
- the weather data is the same as the time period corresponding to the disease monitoring data, and the weather data is the same as the statistical period (eg, daily, weekly) of the disease monitoring data.
- the disease monitoring data is the number of daily visits from January to February 2018, and the weather data is daily weather data for January-February 2018.
- the disease monitoring data is the number of weekly visits from January to December 2017, and the weather data is weekly weather data (eg, weekly average temperature) from January to December 2017.
- the weather data can be captured from weather information websites (such as China Weather Network, Sina Weather, Sohu Weather, etc.) to improve the reliability of the weather data. It can be understood that the weather data can be captured from any webpage.
- weather information websites such as China Weather Network, Sina Weather, Sohu Weather, etc.
- Weather data for a predetermined area can be captured.
- the predetermined area may include a province, a city, a region, and the like. For example, grab weather data from Shenzhen.
- the predetermined time may include a year, a month, a day, and the like. For example, grab daily weather data for January-February 2018.
- the weather data can be captured by a web crawler.
- a web crawler is an application that automatically extracts the content of web page data. Web crawlers usually start with a URL (also called a seed URL) of one or several initial web pages, obtain the URL of the initial web page, and fetch the web page according to specific algorithms and strategies (such as depth-first search strategy). In the process, the new URL is continuously extracted from the current web page and placed in the corresponding queue until the stop condition is satisfied.
- the URL is an abbreviation of Uniform Resource Locator, which is a uniform resource locator.
- the weather data can be captured by using an open API interface of the weather information website (for example, an API interface opened by the China Weather Network).
- the API is an abbreviation of application interface, which can realize mutual communication between computer software through an API interface.
- the open API interface of the weather information website can return data in JSON format or XML format.
- the weather data can be captured by a web crawler using an open API interface of the weather information website. See Figure 2 for the specific process of crawling the weather data through the web crawler using the open API interface of the weather information website.
- Step 103 Acquire public opinion data related to the disease monitoring data, where the public opinion data is time series data corresponding to the disease monitoring data.
- the public opinion data related to the disease surveillance data refers to the public opinion data reflecting the disease monitoring data.
- a disease such as the flu
- many people go online to search for disease-related words (such as flu, Tamiflu, high fever, etc.), which have a large search volume. increase.
- disease-related content such as illness information, treatment information, etc.
- news websites such as news, forums, blogs, and post bars increases. Therefore, disease prediction data can be used to assist in disease prediction.
- the lyric data may include the number of searches for a particular word.
- the number of searches for a particular word by a predetermined search engine can be counted (eg, a specific region pre-sets the number of daily searches by a search engine for a particular word).
- the sensation data may also include the number of lyric information containing a particular word for a particular sensation website (eg, news, forums, blogs, post bars, etc.).
- the specific word is a word related to the predicted disease, for example, the specific word is a word related to the disease symptom, and when the predicted disease is influenza, the specific word may include: sudden onset, high fever, chills, headache , weakness, inflammation of the throat, muscle soreness, dry cough, etc.
- the specific words when the predicted disease is hand, foot and mouth, the specific words may include: mouth pain, anorexia, hypothermia, hand herpes, small mouth ulcers, and the like.
- the time period corresponding to the disease monitoring data is the same, and the public opinion data is the same as the statistical period of the disease monitoring (eg, daily, weekly).
- the disease monitoring data is the number of daily visits from January to February 2018, and the public opinion data is daily sensation data of January-February 2018 (for example, the number of search times for a specific word day).
- the disease monitoring data is the number of weekly visits from January to December 2017, and the public opinion data is weekly sensation data of January-December 2017 (for example, a specific number of word searches).
- steps 101-103 may be performed in any order or in parallel.
- step 104 the disease monitoring data, the weather data, and the public opinion data are preprocessed.
- Pre-processing of disease monitoring data, weather data, and public opinion data may include anomalous data processing.
- Abnormal data processing of disease surveillance data, weather data and public opinion data is to correct abnormal data in the disease monitoring data, weather data and public opinion data, and improve the reliability and accuracy of disease prediction.
- the abnormal data processing can include filling missing values in the disease monitoring data, weather data, and public opinion data.
- the missing values can be filled by the mean or median of the data before and after the missing values, or the missing values can be filled by regression fitting.
- the abnormal data processing may further include correcting abnormal values in the disease monitoring data, weather data, and public opinion data.
- the outlier is a value that deviates significantly from other data. The outlier can be corrected by interpolation.
- Pre-processing of disease monitoring data, weather data, and public opinion data may also include data format conversion of the disease monitoring data, weather data, and public opinion data.
- disease surveillance data, weather data, and public opinion data are standardized so that disease surveillance data, weather data, and public opinion data have a consistent standard format to fit the input data as an LSTM model.
- Step 105 Construct a Long Short-term Memory Recurrent Neural Network model, that is, a multi-layer LSTM model.
- the multi-layer LSTM model includes two layers of LSTM unit layers and one layer of fully connected layers, and the first layer of LSTM unit layers is used to construct features for input data (eg, input data composed of disease monitoring data, weather data, and public opinion data)
- Obtaining a first hidden layer unit wherein the second layer LSTM unit layer is configured to combine the first hidden layer unit to obtain a second hidden layer unit, where the fully connected layer is used according to the second hidden layer
- the unit obtains prediction results (eg, disease prediction results), and each LSTM unit layer includes a forgetting gate, an input gate, and an output gate, and the forgetting gate, the input gate, and the output gate control a memory state of the LSTM unit layer.
- the LSTM model is a time recurrent neural network model. Compared with the traditional Recurrent Neural Network (RNN) model, the LSTM model stores information by constructing some gates in the LSTM unit layer, so the gradient does not disappear quickly during the model training.
- RNN Recurrent Neural Network
- the multi-layer LSTM model used in this method consists of two layers of LSTM unit layers and one layer of fully connected layers.
- the first layer of LSTM unit layers is used to construct features for input data (such as disease monitoring data, weather data, and input data composed of public opinion data).
- Obtaining a first hidden layer unit wherein the second layer LSTM unit layer is configured to combine the first hidden layer units to obtain a second hidden layer unit.
- the fully connected layer obtains a predicted value according to the second hidden layer unit.
- the first hidden layer unit is a local feature
- the second hidden layer unit is a global feature. That is, the first layer LSTM unit layer is used to extract local information, and the second layer LSTM unit layer is used to combine global features to obtain global features, and the fully connected layer is used to obtain prediction results according to global features (eg, disease prediction results). .
- the LSTM unit layer includes a forgetting gate, an input gate, and an output gate, and the forgetting gate, the input gate, and the output gate control the memory state of the LSTM unit layer.
- the input gate determines whether to receive the input at the current time.
- the output gate determines whether or not the memory state is output.
- the forgetting gate f t , the input gate i t , the output gate o t , the memory state c t , and the hidden layer unit h t of the LSTM unit layer can be calculated as follows:
- o t ⁇ (W o x t +U o h t-1 +b o );
- W f , U f , b f are the parameters of the forgetting gate
- W i , U i , b i are the parameters of the input gate
- W o , U o , b o are the parameters of the output gate
- W c , U c , b c is the parameter of the memory unit.
- the forgetting gate f t of the LSTM cell layer, the input gate i t , the output gate o t , the memory state c t , and the hidden layer unit h t can be calculated as follows:
- o t ⁇ (W o x t +U o c t-1 +b o );
- Step 106 Obtain training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and perform training and performance verification on the multi-layer LSTM model by using the training data and the verification data.
- the optimized multi-layer LSTM model is obtained.
- Time series data may be intercepted from the pre-processed disease monitoring data, weather data, and public opinion data to constitute the training data and the verification data.
- the input data of the multi-layer LSTM model is a vector of a preset dimension (eg, 1000 dimensions).
- the pre-processed disease monitoring data, weather data and public opinion data corresponding to each time point may be constructed into a preset dimension vector from the intercepted time series data, and the vectors corresponding to the respective time points are sequentially input into the time sequence.
- the multi-layer LSTM model is used to train or verify the multi-layer LSTM model.
- the corresponding pre-processed disease monitoring data, weather data and public opinion data construct a first vector of a preset dimension, and the first vector corresponding to each time point is sequentially input into the multi-layer LSTM model according to chronological order, for The multi-layer LSTM model is trained.
- the pre-processed disease monitoring data, the weather data, and the public opinion data construct a second vector of a preset dimension, and sequentially input the second vector corresponding to each time point into the multi-layer LSTM model in time sequence, for Multi-layer LSTM model for verification.
- the loss function of the multi-layer LSTM model may be defined as a mean square error, and the parameters of the multi-layer LSTM model are adjusted such that the mean square error takes a minimum value.
- the training process can use the RMSprop algorithm.
- RMSprop is an improved stochastic gradient descent algorithm.
- the mean square error and RMSprop algorithm are prior art and will not be described here.
- Step 107 Obtain disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, and use the disease monitoring data and weather data before the predicted time point. And the lyrical data is input into the optimized multi-layer LSTM model to obtain a disease prediction result at the predicted time point.
- the disease monitoring data, weather data, and public opinion data before the predicted time point are obtained as time series data.
- the disease monitoring data, the weather data and the public opinion data before the predicted time point are obtained, and the pre-processed disease monitoring data, the weather data and the public opinion data corresponding to each time point are constructed into a third vector of a preset dimension. In a chronological order, the third vector corresponding to each time point is sequentially input into the multi-layer LSTM model to perform disease prediction on the predicted time point.
- the optimized multi-layer LSTM model obtains the hidden layer units of the current time point through the input data of the current time point and the hidden layer unit of the previous time point, according to the current
- the hidden layer unit at the time point obtains the predicted value of the current time point, and continuously recursively acquires the hidden layer unit of the next time point and the predicted value according to the chronological order until the predicted value of the given time point is obtained.
- Example 1 predicts disease data through a multi-layer LSTM model.
- the LSTM model can extract knowledge directly from the data, construct a feature vector that is favorable for prediction, and improve the prediction accuracy.
- the LSTM model solves the problem that the long-term dependent time gradient disappears when the amount of time series data is too large.
- the weather data and the public opinion data are included as influence factors in the disease prediction, and the accuracy of the disease prediction is improved.
- FIG. 2 is a detailed flowchart of acquiring weather data related to disease monitoring data (ie, step 102 in FIG. 1) in the disease prediction method provided in the second embodiment of the present application.
- the weather data can be captured by a web crawler using an open API interface of the weather information website. Referring to FIG. 2, the following steps may be specifically included:
- Step 201 Generate a seed URL for the API interface of the weather information website and a subsequent URL.
- the seed URL is the basis and premise for the web crawler to do everything.
- the seed URL can be one or more.
- the structural characteristics of the URL of the weather information website can be analyzed, and the subsequent URLs are obtained according to the structural characteristics of the URL.
- Step 202 Send an HTTP request to an API interface of the weather information website, requesting access to the API interface.
- the HTTP request can be sent to the API interface of the weather information website in GET mode.
- an HTTP response is returned to inform that the weather data can be acquired.
- Step 203 Analyze and identify the data content provided by the weather information website to view the data content.
- the weather information website provides data content in a specific format, and needs to analyze and identify the data content in a specific format provided by the weather information website to view the data content.
- the data format provided by the API interface of the weather information website is in JSON format.
- JSON is a data exchange format that uses a grammar convention similar to C.
- the data content of the JSON format is analyzed and identified to view the data content.
- Step 204 Determine whether the data content is a predetermined information content.
- the data content is a predetermined information content. If the data content is not the predetermined information content, the data content is discarded, otherwise the next step is performed.
- Step 205 If the data content is a predetermined information content, the data content is captured.
- a depth-first search strategy may be used for the state space search when the data content is captured.
- Step 206 Save the captured data content as the weather data to the local.
- a database can be created on the computing device to save the weather data to the database.
- the traditional web crawler first sets one or more portal URLs.
- a new URL is extracted from the current webpage into the queue, so as to obtain the webpage content corresponding to the URL. , save the content of the webpage to the local, and then extract the effective address as the next entry URL until the crawl is completed.
- traditional web crawlers download a large number of irrelevant web pages.
- FIG. 3 is a structural diagram of a disease prediction apparatus according to Embodiment 3 of the present application.
- the disease prediction apparatus 10 may include a first acquisition unit 301, a second acquisition unit 302, a third acquisition unit 303, a pre-processing unit 304, a construction unit 305, an optimization unit 306, and a prediction unit 307.
- the first obtaining unit 301 is configured to acquire disease monitoring data, where the disease monitoring data is time series data.
- the disease monitoring data may include disease data for diseases such as influenza, hand, foot and mouth disease, measles, and mumps.
- a disease monitoring network composed of a plurality of monitoring points may be established in a preset area (for example, a province, a city, a region), and disease monitoring data is acquired from the monitoring points, and the disease monitoring data constitutes time series data constituting the disease monitoring.
- Medical institutions, schools, child care institutions, pharmacies, etc. can be selected as monitoring points to conduct disease monitoring and data collection for the corresponding target population.
- a place that meets the preset conditions can be selected as the monitoring point.
- the preset condition may include a number of people, a scale, and the like. For example, select a school with a predetermined number of schools and child care institutions as monitoring points. Another example is to select a pharmacy that has reached the preset size (for example, by daily turnover) as a monitoring point. For another example, select a hospital (for example, the number of people who seek medical treatment in Japan) to reach a preset size as a monitoring point.
- Disease monitoring data at different times constitute time series data for disease surveillance.
- disease monitoring data collected on a daily basis can be used to form time series data for disease surveillance.
- the disease monitoring data collected on a weekly basis may constitute time series data for disease monitoring.
- Medical institutions (mainly including hospitals) are the best place to capture early warning signs of disease and are the first choice for disease surveillance.
- Disease surveillance data can be obtained based on patient visits.
- the disease monitoring data can be obtained according to the drug sales of the pharmacy.
- the medical institution, the school, the child care institution, and the pharmacy are mainly selected for the collection of disease monitoring data.
- the above selection of data sources does not limit the addition or replacement of other focused populations or sites in other embodiments as a source of data for monitoring.
- hotels can be included in the disease surveillance area to obtain disease surveillance data for hotel residents.
- the disease monitoring data collected by any type of monitoring point can constitute time series data of disease monitoring.
- the disease monitoring data collected by the hospital can be taken to constitute time series data of disease monitoring.
- the disease monitoring data collected by the plurality of types of monitoring points can be combined to form time series data of disease monitoring.
- the disease monitoring data collected by the hospital can be mainly used, supplemented by the disease monitoring data participated by the pharmacy, and constitute time series data of disease monitoring.
- the disease monitoring data may include disease data such as the number of visits to the disease, the rate of visits, the number of cases, and the incidence rate.
- disease data such as the number of visits to the disease, the rate of visits, the number of cases, and the incidence rate.
- the number of daily visits to a disease eg, flu
- a medical institution eg, a hospital
- the number of daily visits of the disease eg, flu
- the daily incidence of a student's disease eg, influenza
- influenza can be obtained from the school, and the daily incidence of the disease (eg, influenza) can be used as disease monitoring data.
- the second obtaining unit 302 is configured to acquire weather data related to the disease monitoring data, and the weather data is time series data corresponding to the disease monitoring data.
- Weather data related to disease surveillance data refers to weather data that affect disease surveillance data (ie disease disease data).
- the influence of different weather data on the disease monitoring data may be analyzed in advance, and weather data having influence or influence on the disease monitoring data may be determined according to the analysis result.
- the weather data may include humidity, temperature, air pressure, precipitation, water vapor pressure, wind speed, wind direction, and sunshine hours.
- the weather data may include daily average temperature, average air pressure, maximum temperature, minimum temperature, average relative humidity, minimum relative humidity, precipitation, average wind speed, sunshine hours, and average water vapor pressure.
- the weather data is the same as the time period corresponding to the disease monitoring data, and the weather data is the same as the statistical period (eg, daily, weekly) of the disease monitoring data.
- the disease monitoring data is the number of daily visits from January to February 2018, and the weather data is daily weather data for January-February 2018.
- the disease monitoring data is the number of weekly visits from January to December 2017, and the weather data is weekly weather data (eg, weekly average temperature) from January to December 2017.
- the weather data can be captured from weather information websites (such as China Weather Network, Sina Weather, Sohu Weather, etc.) to improve the reliability of the weather data. It can be understood that the weather data can be captured from any webpage.
- weather information websites such as China Weather Network, Sina Weather, Sohu Weather, etc.
- Weather data for a predetermined area can be captured.
- the predetermined area may include a province, a city, a region, and the like. For example, grab weather data from Shenzhen.
- the predetermined time may include a year, a month, a day, and the like. For example, grab daily weather data for January-February 2018.
- the weather data can be captured by a web crawler.
- the weather data can be captured by using an open API interface of the weather information website (for example, an API interface opened by the China Weather Network).
- the weather data can be captured by a web crawler using an open API interface of the weather information website. See Figure 2 for the specific process of crawling the weather data through the web crawler using the open API interface of the weather information website.
- the third obtaining unit 303 is configured to acquire public opinion data related to the disease monitoring data, where the public opinion data is time series data corresponding to the disease monitoring data.
- the public opinion data related to the disease surveillance data refers to the public opinion data reflecting the disease monitoring data.
- a disease such as the flu
- many people go online to search for disease-related words (such as flu, Tamiflu, high fever, etc.), which have a large search volume. increase.
- disease-related content such as illness information, treatment information, etc.
- news websites such as news, forums, blogs, and post bars increases. Therefore, disease prediction data can be used to assist in disease prediction.
- the lyric data may include the number of searches for a particular word.
- the number of searches for a particular word by a predetermined search engine can be counted (eg, a specific region pre-sets the number of daily searches by a search engine for a particular word).
- the sensation data may also include the number of lyric information containing a particular word for a particular sensation website (eg, news, forums, blogs, post bars, etc.).
- the specific word is a word related to the predicted disease, for example, the specific word is a word related to the disease symptom, and when the predicted disease is influenza, the specific word may include: sudden onset, high fever, chills, headache , weakness, inflammation of the throat, muscle soreness, dry cough, etc.
- the specific words when the predicted disease is hand, foot and mouth, the specific words may include: mouth pain, anorexia, hypothermia, hand herpes, small mouth ulcers, and the like.
- the time period corresponding to the disease monitoring data is the same, and the public opinion data is the same as the statistical period of the disease monitoring (eg, daily, weekly).
- the disease monitoring data is the number of daily visits from January to February 2018, and the public opinion data is daily sensation data of January-February 2018 (for example, the number of search times for a specific word day).
- the disease monitoring data is the number of weekly visits from January to December 2017, and the public opinion data is weekly sensation data of January-December 2017 (for example, a specific number of word searches).
- the pre-processing unit 304 is configured to pre-process the disease monitoring data, the weather data, and the public opinion data.
- Pre-processing of disease monitoring data, weather data, and public opinion data may include anomalous data processing.
- Abnormal data processing of disease surveillance data, weather data and public opinion data is to correct abnormal data in the disease monitoring data, weather data and public opinion data, and improve the reliability and accuracy of disease prediction.
- the abnormal data processing can include filling missing values in the disease monitoring data, weather data, and public opinion data.
- the missing values can be filled by the mean or median of the data before and after the missing values, or the missing values can be filled by regression fitting.
- the abnormal data processing may further include correcting abnormal values in the disease monitoring data, weather data, and public opinion data.
- the outlier is a value that deviates significantly from other data. The outlier can be corrected by interpolation.
- Pre-processing of disease monitoring data, weather data, and public opinion data may also include data format conversion of the disease monitoring data, weather data, and public opinion data.
- disease surveillance data, weather data, and public opinion data are standardized so that disease surveillance data, weather data, and public opinion data have a consistent standard format to fit the input data as an LSTM model.
- the construction unit 305 is configured to construct a multi-layer long-term memory recurrent neural network model, that is, a multi-layer LSTM model.
- the multi-layer LSTM model includes two layers of LSTM unit layers and one layer of fully connected layers, and the first layer of LSTM unit layers is used to construct features for input data (eg, input data composed of disease monitoring data, weather data, and public opinion data)
- input data eg, input data composed of disease monitoring data, weather data, and public opinion data
- Obtaining a first hidden layer unit wherein the second layer LSTM unit layer is configured to combine the first hidden layer unit to obtain a second hidden layer unit, where the fully connected layer is used according to the second hidden layer
- the unit obtains prediction results (eg, disease prediction results), and each LSTM unit layer includes a forgetting gate, an input gate, and an output gate, and the forgetting gate, the input gate, and the output gate control a memory state of the LSTM unit layer.
- the multi-layer LSTM model used in this method consists of two layers of LSTM unit layers and one layer of fully connected layers.
- the first layer of LSTM unit layers is used to construct features for input data (such as disease monitoring data, weather data, and input data composed of public opinion data).
- Obtaining a first hidden layer unit wherein the second layer LSTM unit layer is configured to combine the first hidden layer units to obtain a second hidden layer unit.
- the fully connected layer obtains a predicted value based on the second hidden layer unit.
- the first hidden layer unit is a local feature
- the second hidden layer unit is a global feature. That is, the first layer LSTM unit layer is used to extract local information, and the second layer LSTM unit layer is used to combine global features to obtain global features, and the fully connected layer is used to obtain prediction results according to global features (eg, disease prediction results). .
- the LSTM unit layer includes a forgetting gate, an input gate, and an output gate, and the forgetting gate, the input gate, and the output gate control the memory state of the LSTM unit layer.
- the input gate determines whether to receive the input at the current time.
- the output gate determines whether or not the memory state is output.
- the forgetting gate f t , the input gate i t , the output gate o t , the memory state c t , and the hidden layer unit h t of the LSTM unit layer can be calculated as follows:
- o t ⁇ (W o x t +U o h t-1 +b o );
- W f , U f , b f are the parameters of the forgetting gate
- W i , U i , b i are the parameters of the input gate
- W o , U o , b o are the parameters of the output gate
- W c , U c , b c is the parameter of the memory unit.
- the forgetting gate f t of the LSTM cell layer, the input gate i t , the output gate o t , the memory state c t , and the hidden layer unit h t can be calculated as follows:
- o t ⁇ (W o x t +U o c t-1 +b o );
- the optimization unit 306 is configured to obtain training data and verification data from the pre-processed disease monitoring data, weather data, and public opinion data, and use the training data and the verification data to train the multi-layer LSTM model and Performance verification, optimized multi-layer LSTM model.
- the time series data may be intercepted from the disease monitoring data, the weather data, and the public opinion data after the pre-processing to constitute the training data and the verification data.
- the input data of the multi-layer LSTM model is a vector of a preset dimension (eg, 1000 dimensions).
- the pre-processed disease monitoring data, weather data and public opinion data corresponding to each time point may be constructed into a preset dimension vector from the intercepted time series data, and the vectors corresponding to the respective time points are sequentially input into the time sequence.
- the multi-layer LSTM model is used to train or verify the multi-layer LSTM model.
- the corresponding pre-processed disease monitoring data, weather data and public opinion data construct a first vector of a preset dimension, and the first vector corresponding to each time point is sequentially input into the multi-layer LSTM model according to chronological order, for The multi-layer LSTM model is trained.
- the pre-processed disease monitoring data, the weather data, and the public opinion data construct a second vector of a preset dimension, and sequentially input the second vector corresponding to each time point into the multi-layer LSTM model in time sequence, for Multi-layer LSTM model for verification.
- the loss function of the multi-layer LSTM model may be defined as a mean square error, and the parameters of the multi-layer LSTM model are adjusted such that the mean square value takes a minimum value.
- the training process can use the RMSprop algorithm.
- RMSprop is an improved stochastic gradient descent algorithm.
- the mean square error and RMSprop algorithm are prior art and will not be described here.
- the predicting unit 307 is configured to obtain disease monitoring data, weather data, and public opinion data before the predicted time point from the pre-processed disease monitoring data, weather data, and public opinion data, and the disease monitoring data before the predicted time point.
- the weather data and the public opinion data are input into the optimized multi-layer LSTM model to obtain the disease prediction result at the predicted time point.
- the disease monitoring data, weather data, and public opinion data before the predicted time point are obtained as time series data.
- the disease monitoring data, the weather data and the public opinion data before the predicted time point are obtained, and the pre-processed disease monitoring data, the weather data and the public opinion data corresponding to each time point are constructed into a third vector of a preset dimension. In a chronological order, the third vector corresponding to each time point is sequentially input into the multi-layer LSTM model to perform disease prediction on the predicted time point.
- the optimized multi-layer LSTM model obtains the hidden layer units of the current time point through the input data of the current time point and the hidden layer unit of the previous time point, according to the current
- the hidden layer unit at the time point obtains the predicted value of the current time point, and continuously recursively acquires the hidden layer unit of the next time point and the predicted value according to the chronological order until the predicted value of the given time point is obtained.
- Example 3 predicts disease data through a multi-layer LSTM model.
- the LSTM model can extract knowledge directly from the data, construct a feature vector that is favorable for prediction, and improve the prediction accuracy.
- the LSTM model solves the problem that the long-term dependent time gradient disappears when the amount of time series data is too large.
- the weather data and the public opinion data are included as influence factors in the disease prediction, and the accuracy of the disease prediction is improved.
- FIG. 4 is a detailed structural diagram of a second acquisition unit (ie, 302 in FIG. 3) in the disease prediction apparatus provided in Embodiment 4 of the present application.
- the second obtaining unit 302 can capture the weather data through a web crawler by using an API interface opened by the weather information website.
- the second obtaining unit 302 may include: a generating subunit 3021, a requesting subunit 3022, an analyzing subunit 3023, a determining subunit 3024, a grabbing subunit 3025, and a storing subunit 3026.
- a generating subunit 3021 is configured to generate a seed URL for the API interface of the weather information website and a subsequent URL.
- the seed URL is the basis and premise for the web crawler to do everything.
- the seed URL can be one or more.
- the structural characteristics of the URL of the weather information website can be analyzed, and the subsequent URLs are obtained according to the structural characteristics of the URL.
- the requesting subunit 3022 is configured to send an HTTP request to the API interface of the weather information website to request access to the API interface.
- the HTTP request can be sent to the API interface of the weather information website in GET mode.
- an HTTP response is returned to inform that the weather data can be acquired.
- the analyzing subunit 3023 is configured to analyze and identify the data content provided by the weather information website to view the data content.
- the weather information website provides data content in a specific format, and needs to analyze and identify the data content in a specific format provided by the weather information website to view the data content.
- the data format provided by the API interface of the weather information website is in JSON format.
- JSON is a data exchange format that uses a grammar convention similar to C.
- the data content of the JSON format is analyzed and identified to view the data content.
- the determining subunit 3024 is configured to determine whether the data content is a predetermined information content.
- the data content is a predetermined information content. If the data content is not the predetermined information content, the data content is discarded, otherwise the next step is performed.
- the capture subunit 3025 is configured to capture the data content if the data content is a predetermined information content.
- a depth-first search strategy may be used for the state space search when the data content is captured.
- the storage subunit 3026 is configured to save the captured data content as the weather data to the local.
- a database can be created on the computing device to save the weather data to the database.
- the second obtaining unit 302 uses the API interface opened by the weather information website to capture the weather data through the web crawler, thereby avoiding downloading irrelevant web pages and efficiently acquiring weather data, thereby improving the efficiency of disease prediction.
- FIG. 5 is a schematic diagram of a computer apparatus according to Embodiment 5 of the present application.
- the computer device 1 includes a memory 20, a processor 30, and computer readable instructions 40, such as a disease prediction program, stored in the memory 20 and executable on the processor 30.
- the processor 30 executes the computer readable instructions 40, the steps in the above-described disease prediction method embodiment are implemented, such as steps 101-107 shown in FIG.
- the processor 30, when executing the computer readable instructions 40, implements the functions of the various modules/units in the apparatus embodiments described above, such as units 301-307 in FIG.
- the computer readable instructions 40 may be partitioned into one or more modules/units that are stored in the memory 20 and executed by the processor 30, To complete this application.
- the one or more modules/units may be a series of computer readable instruction segments capable of performing a particular function for describing the execution of the computer readable instructions 40 in the computer device 1.
- the computer readable instructions 40 may be divided into the units 301, 302, 303, 304, 305, 306, 307 in FIG. 3, and the function of each unit is referred to the third embodiment.
- the computer device 1 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. It will be understood by those skilled in the art that the schematic diagram 5 is merely an example of the computer device 1, and does not constitute a limitation of the computer device 1, and may include more or less components than those illustrated, or some components may be combined, or different.
- the components, such as the computer device 1, may also include input and output devices, network access devices, buses, and the like.
- the processor 30 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.
- the general purpose processor may be a microprocessor or the processor 30 may be any conventional processor or the like, and the processor 30 is a control center of the computer device 1, and connects the entire computer device 1 by using various interfaces and lines. Various parts.
- the memory 20 can be used to store the computer readable instructions 40 and/or modules/units by running or executing computer readable instructions and/or modules/units stored in the memory 20, and The various functions of the computer device 1 are realized by calling data stored in the memory 20.
- the memory 20 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be Data (such as audio data, phone book, etc.) created according to the use of the computer device 1 is stored.
- the memory 20 may include a high-speed random access memory, and may also include a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (Secure Digital, SD).
- a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (Secure Digital, SD).
- SMC smart memory card
- SD Secure Digital
- Card flash card, at least one disk storage device, flash device, or other volatile solid state storage device.
- the modules/units integrated by the computer device 1 can be stored in a non-volatile readable storage medium if implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the present application implements all or part of the processes in the foregoing embodiments, and may also be implemented by computer-readable instructions, which may be stored in a non-volatile manner. In reading a storage medium, the computer readable instructions, when executed by a processor, implement the steps of the various method embodiments described above.
Landscapes
- Health & Medical Sciences (AREA)
- Public Health (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Biomedical Technology (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Pathology (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Primary Health Care (AREA)
- Medical Treatment And Welfare Office Work (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
Claims (20)
- 一种疾病预测方法,其特征在于,所述方法包括:获取疾病监测数据,所述疾病监测数据是时间序列数据;获取所述疾病监测数据相关的天气数据,所述天气数据是与所述疾病监测数据对应的时间序列数据;获取所述疾病监测数据相关的舆情数据,所述舆情数据是与所述疾病监测数据对应的时间序列数据;对所述疾病监测数据、天气数据和舆情数据进行预处理;构建多层长短时记忆递归神经网络模型,即多层LSTM模型;从预处理后的所述疾病监测数据、天气数据和舆情数据中获取训练数据和验证数据,利用所述训练数据和所述验证数据对所述多层LSTM模型进行训练和性能验证,得到优化后的多层LSTM模型;从预处理后的所述疾病监测数据、天气数据和舆情数据中获取预测时间点之前的疾病监测数据、天气数据和舆情数据,将所述预测时间点之前的疾病监测数据、天气数据和舆情数据输入所述优化后的多层LSTM模型,得到所述预测时间点的疾病预测结果。
- 如权利要求1所述的方法,其特征在于,所述从网页中抓取天气数据包括:生成面向天气信息网站的API接口的种子URL以及后续的URL;向所述天气信息网站的API接口发送HTTP请求,请求访问所述API接口;对所述天气信息网站提供的数据内容进行分析和识别,以查看所述数据内容;判断所述数据内容是否为预定信息内容;若所述数据内容为预定信息内容,则抓取所述数据内容;将抓取的数据内容作为所述天气数据保存到本地。
- 如权利要求1所述的方法,其特征在于,所述舆情数据包括:特定词的搜索次数;或者特定舆情网站包含特定词的舆情信息的数量。
- 如权利要求1所述的方法,其特征在于,所述对所述疾病监测数据、天气数据和舆情数据进行预处理包括:填补所述疾病监测数据、天气数据和舆情数据中的缺失值;修正对所述疾病监测数据、天气数据和舆情数据中的异常值;对所述疾病监测数据、天气数据和舆情数据进行数据格式转换。
- 如权利要求1-4中任一项所述的方法,其特征在于,所述天气数据包括湿度、气温、气压、降水量、水汽压、风速、风向、日照时数。
- 如权利要求1-4中任一项所述的方法,其特征在于,所述多层LSTM模型包括两层LSTM单元层和一层全连接层,第一层LSTM单元层用于对输入数据构造特征,得到第一隐藏层单元,第二层LSTM单元层用于对所述第一隐藏 层单元进行组合,得到第二隐藏层单元,所述全连接层用于根据所述第二隐藏层单元得到预测结果,每个LSTM单元层包括遗忘门、输入门、输出门,所述遗忘门、输入门、输出门控制所述LSTM单元层的记忆状态。
- 如权利要求1-4中任一项所述的方法,其特征在于,所述多层LSTM模型训练过程中使用的损失函数为均方差,使用的算法为RMSprop算法。
- 一种疾病预测装置,其特征在于,所述装置包括:第一获取单元,用于获取疾病监测数据,所述疾病监测数据是时间序列数据;第二获取单元,用于获取所述疾病监测数据相关的天气数据,所述天气数据是与所述疾病监测数据对应的时间序列数据;第三获取单元,用于获取所述疾病监测数据相关的舆情数据,所述舆情数据是与所述疾病监测数据对应的时间序列数据;预处理单元,用于对所述疾病监测数据、天气数据和舆情数据进行预处理;构建单元,用于构建多层长短时记忆递归神经网络模型,即多层LSTM模型;优化单元,用于从预处理后的所述疾病监测数据、天气数据和舆情数据中获取训练数据和验证数据,利用所述训练数据和所述验证数据对所述多层LSTM模型进行训练和性能验证,得到优化后的多层LSTM模型;预测单元,用于从预处理后的所述疾病监测数据、天气数据和舆情数据中获取预测时间点之前的疾病监测数据、天气数据和舆情数据,将所述预测时间点之前的疾病监测数据、天气数据和舆情数据输入所述优化后的多层LSTM模型,得到所述预测时间点的疾病预测结果。
- 一种计算机装置,其特征在于,所述计算机装置包括存储器及处理器,所述存储器用于存储至少一个计算机可读指令,所述处理器用于执行所述至少一个计算机可读指令以实现以下步骤:获取疾病监测数据,所述疾病监测数据是时间序列数据;获取所述疾病监测数据相关的天气数据,所述天气数据是与所述疾病监测数据对应的时间序列数据;获取所述疾病监测数据相关的舆情数据,所述舆情数据是与所述疾病监测数据对应的时间序列数据;对所述疾病监测数据、天气数据和舆情数据进行预处理;构建多层长短时记忆递归神经网络模型,即多层LSTM模型;从预处理后的所述疾病监测数据、天气数据和舆情数据中获取训练数据和验证数据,利用所述训练数据和所述验证数据对所述多层LSTM模型进行训练和性能验证,得到优化后的多层LSTM模型;从预处理后的所述疾病监测数据、天气数据和舆情数据中获取预测时间点之前的疾病监测数据、天气数据和舆情数据,将所述预测时间点之前的疾病监测数据、天气数据和舆情数据输入所述优化后的多层LSTM模型,得到所述预测时间点的疾病预测结果。
- 如权利要求9所述的计算机装置,其特征在于,所述从网页中抓取天气数据包括:生成面向天气信息网站的API接口的种子URL以及后续的URL;向所述天气信息网站的API接口发送HTTP请求,请求访问所述API接口;对所述天气信息网站提供的数据内容进行分析和识别,以查看所述数据内容;判断所述数据内容是否为预定信息内容;若所述数据内容为预定信息内容,则抓取所述数据内容;将抓取的数据内容作为所述天气数据保存到本地。
- 如权利要求9所述的计算机装置,其特征在于,所述舆情数据包括:特定词的搜索次数;或者特定舆情网站包含特定词的舆情信息的数量。
- 如权利要求9所述的计算机装置,其特征在于,所述对所述疾病监测数据、天气数据和舆情数据进行预处理包括:填补所述疾病监测数据、天气数据和舆情数据中的缺失值;修正对所述疾病监测数据、天气数据和舆情数据中的异常值;对所述疾病监测数据、天气数据和舆情数据进行数据格式转换。
- 如权利要求9-12中任一项所述的计算机装置,其特征在于,所述天气数据包括湿度、气温、气压、降水量、水汽压、风速、风向、日照时数。
- 如权利要求9-12中任一项所述的计算机装置,其特征在于,所述多层LSTM模型包括两层LSTM单元层和一层全连接层,第一层LSTM单元层用于对输入数据构造特征,得到第一隐藏层单元,第二层LSTM单元层用于对所述第一隐藏层单元进行组合,得到第二隐藏层单元,所述全连接层用于根据所述第二隐藏层单元得到预测结果,每个LSTM单元层包括遗忘门、输入门、输出门,所述遗忘门、输入门、输出门控制所述LSTM单元层的记忆状态。
- 一种非易失性可读存储介质,其特征在于,所述非易失性可读存储介质存储有至少一个计算机可读指令,所述至少一个计算机可读指令被处理器执行时实现以下步骤:获取疾病监测数据,所述疾病监测数据是时间序列数据;获取所述疾病监测数据相关的天气数据,所述天气数据是与所述疾病监测数据对应的时间序列数据;获取所述疾病监测数据相关的舆情数据,所述舆情数据是与所述疾病监测数据对应的时间序列数据;对所述疾病监测数据、天气数据和舆情数据进行预处理;构建多层长短时记忆递归神经网络模型,即多层LSTM模型;从预处理后的所述疾病监测数据、天气数据和舆情数据中获取训练数据和验证数据,利用所述训练数据和所述验证数据对所述多层LSTM模型进行训练和性能验证,得到优化后的多层LSTM模型;从预处理后的所述疾病监测数据、天气数据和舆情数据中获取预测时间点之前的疾病监测数据、天气数据和舆情数据,将所述预测时间点之前的疾病监测 数据、天气数据和舆情数据输入所述优化后的多层LSTM模型,得到所述预测时间点的疾病预测结果。
- 如权利要求15所述的存储介质,其特征在于,所述从网页中抓取天气数据包括:生成面向天气信息网站的API接口的种子URL以及后续的URL;向所述天气信息网站的API接口发送HTTP请求,请求访问所述API接口;对所述天气信息网站提供的数据内容进行分析和识别,以查看所述数据内容;判断所述数据内容是否为预定信息内容;若所述数据内容为预定信息内容,则抓取所述数据内容;将抓取的数据内容作为所述天气数据保存到本地。
- 如权利要求15所述的存储介质,其特征在于,所述舆情数据包括:特定词的搜索次数;或者特定舆情网站包含特定词的舆情信息的数量。
- 如权利要求15所述的存储介质,其特征在于,所述对所述疾病监测数据、天气数据和舆情数据进行预处理包括:填补所述疾病监测数据、天气数据和舆情数据中的缺失值;修正对所述疾病监测数据、天气数据和舆情数据中的异常值;对所述疾病监测数据、天气数据和舆情数据进行数据格式转换。
- 如权利要求15-18中任一项所述的存储介质,其特征在于,所述天气数据包括湿度、气温、气压、降水量、水汽压、风速、风向、日照时数。
- 如权利要求15-18中任一项所述的存储介质,其特征在于,所述多层LSTM模型包括两层LSTM单元层和一层全连接层,第一层LSTM单元层用于对输入数据构造特征,得到第一隐藏层单元,第二层LSTM单元层用于对所述第一隐藏层单元进行组合,得到第二隐藏层单元,所述全连接层用于根据所述第二隐藏层单元得到预测结果,每个LSTM单元层包括遗忘门、输入门、输出门,所述遗忘门、输入门、输出门控制所述LSTM单元层的记忆状态。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2019572832A JP2020527788A (ja) | 2018-04-11 | 2018-08-10 | 疾患予測方法および装置、コンピューター装置及び可読記憶媒体 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810321868.XA CN108648829A (zh) | 2018-04-11 | 2018-04-11 | 疾病预测方法及装置、计算机装置及可读存储介质 |
| CN201810321868.X | 2018-04-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019196286A1 true WO2019196286A1 (zh) | 2019-10-17 |
Family
ID=63746032
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2018/099847 Ceased WO2019196286A1 (zh) | 2018-04-11 | 2018-08-10 | 疾病预测方法及装置、计算机装置及可读存储介质 |
Country Status (3)
| Country | Link |
|---|---|
| JP (1) | JP2020527788A (zh) |
| CN (1) | CN108648829A (zh) |
| WO (1) | WO2019196286A1 (zh) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111370122A (zh) * | 2020-02-27 | 2020-07-03 | 西安交通大学 | 一种基于知识指导的时序数据风险预测方法、系统及其应用 |
| CN111968753A (zh) * | 2020-08-06 | 2020-11-20 | 平安科技(深圳)有限公司 | 疫情监控方法、装置、计算机设备和存储介质 |
| CN112100498A (zh) * | 2020-09-16 | 2020-12-18 | 北京百度网讯科技有限公司 | 疾病舆情的监控方法、装置 |
| CN113035352A (zh) * | 2021-04-27 | 2021-06-25 | 河南科技大学 | 基于bp神经网络的糖尿病视网膜病变预警方法 |
| CN113057588A (zh) * | 2021-03-17 | 2021-07-02 | 上海电气集团股份有限公司 | 一种病症预警方法、装置、设备及介质 |
| CN113161002A (zh) * | 2020-01-22 | 2021-07-23 | 广东毓秀科技有限公司 | 一种基于深度时空残差网络预测登革热疾病的方法 |
| CN113268871A (zh) * | 2021-05-21 | 2021-08-17 | 燕山大学 | 基于多变量时序深度网络模型的水泥烟囱nox预测方法 |
| CN116013522A (zh) * | 2022-12-31 | 2023-04-25 | 中日友好医院(中日友好临床医学研究所) | 一种用于带状疱疹后遗神经痛的预测方法及系统 |
Families Citing this family (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109473177B (zh) * | 2018-10-31 | 2023-07-14 | 平安科技(深圳)有限公司 | 基于预测模型确定医疗发展趋势的方法及相关产品 |
| CN109545386B (zh) * | 2018-11-02 | 2021-07-20 | 深圳先进技术研究院 | 一种基于深度学习的流感时空预测方法及装置 |
| CN109599177B (zh) * | 2018-11-27 | 2023-04-11 | 华侨大学 | 一种基于病历的深度学习预测医疗轨迹的方法 |
| CN109615226B (zh) * | 2018-12-12 | 2020-12-29 | 焦点科技股份有限公司 | 一种运营指标异常监测方法 |
| CN109859854A (zh) * | 2018-12-17 | 2019-06-07 | 中国科学院深圳先进技术研究院 | 传染病预测方法、装置、电子设备及计算机可读介质 |
| CN109656918A (zh) * | 2019-01-04 | 2019-04-19 | 平安科技(深圳)有限公司 | 流行病发病指数的预测方法、装置、设备及可读存储介质 |
| CN110085327A (zh) * | 2019-04-01 | 2019-08-02 | 东莞理工学院 | 基于注意力机制的多通道lstm神经网络流感疫情预测方法 |
| CN109991685A (zh) * | 2019-04-03 | 2019-07-09 | 北京市天元网络技术股份有限公司 | 一种基于多lstm模型融合的降水量预测方法以及装置 |
| CN110162398B (zh) * | 2019-04-11 | 2024-05-03 | 平安科技(深圳)有限公司 | 一种疾病分析模型的调度方法、装置及终端设备 |
| CN110111885B (zh) * | 2019-05-09 | 2023-09-19 | 腾讯科技(深圳)有限公司 | 属性预测方法、装置、计算机设备及计算机可读存储介质 |
| CN110379522B (zh) * | 2019-07-23 | 2022-08-12 | 四川骏逸富顿科技有限公司 | 一种疾病流行趋势预测系统及方法 |
| CN110675959B (zh) * | 2019-08-19 | 2023-07-07 | 平安科技(深圳)有限公司 | 数据智能分析方法、装置、计算机设备及存储介质 |
| CN110491522A (zh) * | 2019-08-28 | 2019-11-22 | 九州通医疗信息科技(武汉)有限公司 | 基于药品销售数据的传染病监控方法及系统 |
| CN110706823A (zh) * | 2019-11-15 | 2020-01-17 | 广州地理研究所 | 一种基于滞后分析和lstm的呼吸系统疾病发病人数预测方法 |
| CN111161880B (zh) * | 2019-12-23 | 2022-12-02 | 深圳平安医疗健康科技服务有限公司 | 基于分类模型的医疗信息分类方法、装置和计算机设备 |
| CN111312401B (zh) * | 2020-01-14 | 2021-12-17 | 之江实验室 | 一种基于多标签学习的体检后慢性疾病预后系统 |
| CN111415752B (zh) * | 2020-03-01 | 2023-05-12 | 集美大学 | 一种融合气象因素和搜索指数的手足口病预测方法 |
| CN111430040A (zh) * | 2020-03-03 | 2020-07-17 | 广东省公共卫生研究院 | 基于病例、气象和病原监测数据的手足口病疫情预测方法 |
| CN111986763B (zh) * | 2020-09-03 | 2024-05-14 | 深圳平安智慧医健科技有限公司 | 疾病数据分析方法、装置、电子设备及存储介质 |
| CN111933300B (zh) * | 2020-09-28 | 2021-02-12 | 平安科技(深圳)有限公司 | 疫情防控效果预测方法、装置、服务器及存储介质 |
| CN111883262B (zh) * | 2020-09-28 | 2021-01-15 | 平安科技(深圳)有限公司 | 疫情趋势预测方法、装置、电子设备及存储介质 |
| CN115064276B (zh) * | 2022-06-23 | 2024-09-27 | 重庆三峡医药高等专科学校 | 一种使用自注意力机制的疾病预测方法 |
| CN119560175A (zh) * | 2024-11-04 | 2025-03-04 | 天津大学 | 一种流感流行趋势预测预警方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105812463A (zh) * | 2016-03-10 | 2016-07-27 | 深圳市前海安测信息技术有限公司 | 基于医疗大数据的疾病预警系统及方法 |
| CN106030589A (zh) * | 2014-02-19 | 2016-10-12 | 赫尔实验室有限公司 | 使用开源数据的疾病预测系统 |
| CN107180152A (zh) * | 2016-03-09 | 2017-09-19 | 日本电气株式会社 | 疾病预测系统及方法 |
| CN108288502A (zh) * | 2018-04-11 | 2018-07-17 | 平安科技(深圳)有限公司 | 疾病预测方法及装置、计算机装置及可读存储介质 |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105022783A (zh) * | 2015-06-03 | 2015-11-04 | 南京邮电大学 | 一种基于Hadoop的用户服务安全系统和方法 |
| CN106529113A (zh) * | 2015-09-15 | 2017-03-22 | 平安科技(深圳)有限公司 | 提醒信息的发送方法及服务器 |
| JP6551101B2 (ja) * | 2015-09-17 | 2019-07-31 | 日本電気株式会社 | 情報処理装置、情報処理方法、及び、プログラム |
| CN105678080A (zh) * | 2016-01-11 | 2016-06-15 | 浪潮集团有限公司 | 通过大数据搜寻分析预测流感爆发可能性的方法 |
| CN105808942A (zh) * | 2016-03-04 | 2016-07-27 | 深圳市前海安测信息技术有限公司 | 医疗大数据分析及预警系统及方法 |
| CN106022527A (zh) * | 2016-05-27 | 2016-10-12 | 河南明晰信息科技有限公司 | 基于地图瓦片和lstm循环神经网络的轨迹预测方法和装置 |
| JP6951712B2 (ja) * | 2016-09-30 | 2021-10-20 | 株式会社Nextremer | 対話装置、対話システム、対話方法、およびプログラム |
| CN107239859B (zh) * | 2017-06-05 | 2018-05-08 | 国网山东省电力公司电力科学研究院 | 基于串联长短期记忆循环神经网络的供热负荷预测方法 |
-
2018
- 2018-04-11 CN CN201810321868.XA patent/CN108648829A/zh active Pending
- 2018-08-10 JP JP2019572832A patent/JP2020527788A/ja active Pending
- 2018-08-10 WO PCT/CN2018/099847 patent/WO2019196286A1/zh not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106030589A (zh) * | 2014-02-19 | 2016-10-12 | 赫尔实验室有限公司 | 使用开源数据的疾病预测系统 |
| CN107180152A (zh) * | 2016-03-09 | 2017-09-19 | 日本电气株式会社 | 疾病预测系统及方法 |
| CN105812463A (zh) * | 2016-03-10 | 2016-07-27 | 深圳市前海安测信息技术有限公司 | 基于医疗大数据的疾病预警系统及方法 |
| CN108288502A (zh) * | 2018-04-11 | 2018-07-17 | 平安科技(深圳)有限公司 | 疾病预测方法及装置、计算机装置及可读存储介质 |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113161002A (zh) * | 2020-01-22 | 2021-07-23 | 广东毓秀科技有限公司 | 一种基于深度时空残差网络预测登革热疾病的方法 |
| CN111370122A (zh) * | 2020-02-27 | 2020-07-03 | 西安交通大学 | 一种基于知识指导的时序数据风险预测方法、系统及其应用 |
| CN111370122B (zh) * | 2020-02-27 | 2023-12-19 | 西安交通大学 | 一种基于知识指导的时序数据风险预测方法、系统及其应用 |
| CN111968753A (zh) * | 2020-08-06 | 2020-11-20 | 平安科技(深圳)有限公司 | 疫情监控方法、装置、计算机设备和存储介质 |
| CN112100498A (zh) * | 2020-09-16 | 2020-12-18 | 北京百度网讯科技有限公司 | 疾病舆情的监控方法、装置 |
| CN113057588A (zh) * | 2021-03-17 | 2021-07-02 | 上海电气集团股份有限公司 | 一种病症预警方法、装置、设备及介质 |
| CN113035352A (zh) * | 2021-04-27 | 2021-06-25 | 河南科技大学 | 基于bp神经网络的糖尿病视网膜病变预警方法 |
| CN113268871A (zh) * | 2021-05-21 | 2021-08-17 | 燕山大学 | 基于多变量时序深度网络模型的水泥烟囱nox预测方法 |
| CN116013522A (zh) * | 2022-12-31 | 2023-04-25 | 中日友好医院(中日友好临床医学研究所) | 一种用于带状疱疹后遗神经痛的预测方法及系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108648829A (zh) | 2018-10-12 |
| JP2020527788A (ja) | 2020-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019196286A1 (zh) | 疾病预测方法及装置、计算机装置及可读存储介质 | |
| WO2019196280A1 (zh) | 疾病预测方法及装置、计算机装置及可读存储介质 | |
| Hassan Zadeh et al. | Social media for nowcasting flu activity: spatio-temporal big data analysis | |
| US20210125732A1 (en) | System and method with federated learning model for geotemporal data associated medical prediction applications | |
| Lee et al. | Forecasting influenza levels using real-time social media streams | |
| Manocha et al. | Digital Twin-assisted Blockchain-inspired irregular event analysis for eldercare | |
| US11557399B2 (en) | Integrative machine learning framework for combining sentiment-based and symptom-based predictive inferences | |
| WO2019196278A1 (zh) | 天气数据获取方法及装置、计算机装置及可读存储介质 | |
| Turk et al. | A predictive internet-based model for COVID-19 hospitalization census | |
| US20260010793A1 (en) | Neural signal detection | |
| CN120511074A (zh) | 基于多模态数据的事件分析方法、装置、设备及介质 | |
| CN115116608A (zh) | 疾病预测方法、装置、存储介质、设备及程序产品 | |
| Wang | Public health emergency decision-making and management system sound research using rough set attribute reduction and blockchain | |
| CN115577348A (zh) | 用户异常操作行为识别方法及装置 | |
| Kariyapperuma et al. | Classification of covid19 vaccine-related tweets using deep learning | |
| Li et al. | Application of a Mobile Chronic Disease Health‐Care System for Hypertension Based on Big Data Platforms | |
| Munshi et al. | A deep learning-based approach for predicting COVID-19 diagnosis | |
| McMurry et al. | Cumulus: A federated EHR-based learning system powered by FHIR and AI | |
| CN115630724A (zh) | 灾害区域预测方法、装置、设备及存储介质 | |
| CN118299064B (zh) | 基于罕见病的图模型训练方法、应用方法及相关设备 | |
| Galbraith et al. | In. To. COVID-19 socio-epidemiological co-causality | |
| CN111488500A (zh) | 一种医学问题信息处理方法、装置和存储介质 | |
| Mavragani et al. | Exploring the role of non-pharmaceutical interventions (NPIs) in flattening the Greek COVID-19 epidemic curve | |
| Nguyen et al. | Estimating county health indices using graph neural networks | |
| CN113780855B (zh) | 医疗机构监管方法、装置、计算机设备及存储介质 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18914782 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2019572832 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21/01/2021) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 18914782 Country of ref document: EP Kind code of ref document: A1 |