TWI646808B - Request traffic prediction method - Google Patents

Request traffic prediction method Download PDF

Info

Publication number
TWI646808B
TWI646808B TW106109858A TW106109858A TWI646808B TW I646808 B TWI646808 B TW I646808B TW 106109858 A TW106109858 A TW 106109858A TW 106109858 A TW106109858 A TW 106109858A TW I646808 B TWI646808 B TW I646808B
Authority
TW
Taiwan
Prior art keywords
voucher
request
traffic
neural network
cluster
Prior art date
Application number
TW106109858A
Other languages
Chinese (zh)
Other versions
TW201728134A (en
Inventor
陳志華
童韋豪
林邦曄
江彬榮
張保忠
Original Assignee
中華電信股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中華電信股份有限公司 filed Critical 中華電信股份有限公司
Priority to TW106109858A priority Critical patent/TWI646808B/en
Publication of TW201728134A publication Critical patent/TW201728134A/en
Application granted granted Critical
Publication of TWI646808B publication Critical patent/TWI646808B/en

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

本發明有關於一種請求流量預測方法,主要為進行預測後,再按照請求流量預測值對該憑證狀態簽章,以取得較準確的預簽章憑證狀態數量,並達成回覆簽章子系統之負載平衡。 The invention relates to a method for requesting traffic prediction, which mainly performs a prediction, and then signs the voucher status according to the requested traffic prediction value, so as to obtain a more accurate pre-signature voucher state quantity, and achieve the load of the reply signature subsystem. balance.

Description

一種請求流量預測方法 Request traffic prediction method

本發明有關於一種請求流量預測方法。 The invention relates to a method for requesting traffic prediction.

目前,線上憑證狀態通訊協定方法在運作上仍主要係採用即時線上查詢憑證和回覆憑證等方式,但因目前之回覆簽章系統在進行簽章時會花費較多處理時間,將會進一步造成回覆客戶端設備時的延宕,另外,請求流量因時段增加也會對憑證伺服器和回覆簽章系統造成無法預期的負擔,在無法負荷時最嚴重將導致系統當機。 At present, the online voucher status communication protocol method still mainly uses real-time online inquiry voucher and reply voucher, but the current reply signature system will take more processing time when signing the signature, which will further cause a reply. Delays in the client device. In addition, the request traffic may cause an unpredictable burden on the credential server and the reply signature system due to the increase in the time period. When the load cannot be loaded, the most serious will cause the system to crash.

而為了避免上述狀況,目前已有些網路流量預測方法實行於現行技術中,目前的網路流量預測方法主要採用統計方法和灰色理論來進行預估,然而該些技術皆需要進行大量統計,並且因為用戶之請求流量變異很大,該些技術很可能得到較大的請求流量估計誤差,導致預測不準確。 In order to avoid the above situation, some network traffic prediction methods have been implemented in the current technology. The current network traffic prediction methods mainly use statistical methods and grey theory to estimate, but these technologies require a large amount of statistics, and Because the user's request traffic varies greatly, these techniques are likely to get larger request traffic estimation errors, resulting in inaccurate predictions.

關於流量預測之技術,可參照中華民國專利號第I234974號「植基於灰預測來預測分散式阻斷服務攻擊之機制」之技術,其主要係以數據收集分類模組,並結合灰色理論與防範策略進行網路流量模式之分析與預測,以藉此判斷及防禦分散式阻斷服務攻擊;然而,此方法雖然可以進行網路流量預測和防範網路攻擊在實施過程中,其運用灰色理論且需 要進行大量統計,和承受網路流量變異過大之可能性,實證出其網路流量估計值實非相當準確。 For the technology of traffic forecasting, refer to the technology of the Republic of China Patent No. I234974 "Improving the Mechanism of Decentralized Blocking Service Attacks Based on Grey Prediction", which mainly uses data collection and classification modules, combined with grey theory and prevention. The strategy analyzes and predicts the network traffic pattern to judge and defend against decentralized blocking service attacks. However, although this method can perform network traffic prediction and prevent network attacks in the implementation process, it uses gray theory and need To conduct a large number of statistics, and to withstand the possibility of excessive variability in network traffic, it is not quite accurate to empirically estimate its network traffic.

且就算系統已預測出特定時段之可能流量值,該如何紓解高峰時段的負載量,先前技術中仍未見有配合之處理模式。 And even if the system has predicted the possible flow value for a certain period of time, how to understand the load during peak hours, there is still no matching processing mode in the prior art.

綜上所述,故提出一種有效率且系統性的預測憑證請求流量系統或方法,並據其預先處理特定時段的憑證可能高負載量,實為本發明所屬領域極其需要的一個課題。 To sum up, it is proposed that an efficient and systematic forecasting voucher request flow system or method, and pre-processing a voucher of a certain time period may be a high load, which is an extremely urgent subject in the field to which the present invention pertains.

本發明係包含一種預測請求流量之憑證預簽系統,其係由下列系統與資料庫所組成:其中,本發明預測請求流量之憑證預簽系統包含有一憑證資料庫,該憑證資料庫係通過網路與系統外部的一憑證狀態通訊協定伺服器連結,該憑證資料庫之功能為儲存複數憑證被請求之紀錄,前述各該憑證被請求之紀錄係為系統外部的複數終端設備向前述該憑證狀態通訊協定伺服器請求憑證的時間點之紀錄,亦即該憑證資料庫會將所有時段中終端設備請求某一憑證的時間資料儲存於其中。 The present invention comprises a voucher pre-signing system for predicting request traffic, which is composed of the following system and database: wherein the voucher pre-signing system for predicting request traffic of the present invention comprises a voucher database, the voucher database is through the network. The road is connected with a voucher status communication protocol server outside the system, and the function of the voucher database is to store a record in which the plurality of voucher is requested, and the record of each of the voucher requests is a status of the plurality of terminal devices external to the system to the voucher status. The time point of the communication protocol server requesting the voucher, that is, the voucher database stores the time data of the terminal device requesting a voucher in all time periods.

其中,本發明預測請求流量之憑證預簽系統包含有一請求流量預測子系統,該請求流量預測子系統係取得前述該憑證資料庫中各該憑證被請求之紀錄,通過請求流量分群方法將紀錄分群,或是直接使用紀錄資料,進行分析紀錄後建立複數類神經網路來預測各該憑證在特定時段的被請求流量,以產生一請求流量預測值;該請求流量預測子系統可通過一種請求流量分群方法將紀錄分群後來訓練各該類神經 網路,或是直接使用紀錄資料來訓練各該類神經網路,以保留其中預測準確度較高者;該請求流量預測子系統更可通過分析各該憑證被請求之紀錄以找出被請求流量較高的憑證,以對這些需求量較高之憑證進行預測。 The voucher pre-signing system for predicting request traffic of the present invention comprises a request traffic prediction subsystem, wherein the request traffic prediction subsystem obtains a record of each voucher requested in the voucher database, and groups the records by requesting a traffic grouping method. Or directly using the record data, performing an analysis record and establishing a complex neural network to predict the requested traffic of each voucher at a specific time period to generate a request traffic prediction value; the request traffic prediction subsystem can pass a request traffic Grouping method, grouping records, and training each of these types of nerves Network, or directly use the record data to train each of these neural networks to retain the higher accuracy of the prediction; the request traffic prediction subsystem can also find out the requested request by analyzing the records of each of the credentials. A voucher with a higher flow rate is used to predict these high-valued documents.

其中,該請求流量預測值將被傳輸至一回覆簽章子系統,該回覆簽章子系統則依據該請求流量預測值對相應數量的各該憑證預簽章以產生複數預簽章憑證狀態,亦即該回覆簽章子系統即為對某一憑證在特定時段會被請求的數量預先對憑證作簽章,以應對該時段到來時之憑證需求;而該回覆簽章子系統會將各該預簽章憑證狀態儲存至該憑證資料庫,該憑證資料庫則將各該預簽章憑證狀態提供至該憑證狀態通訊協定伺服器以供外部各該終端設備請求憑證時使用。 The request traffic prediction value is transmitted to a reply signature subsystem, and the reply signature subsystem pre-signs the corresponding number of the certificates according to the requested traffic prediction value to generate a plurality of pre-signature voucher states. That is, the reply signature subsystem pre-certifies the voucher for the quantity that a voucher will be requested at a certain time period to cope with the voucher demand at the arrival of the time period; and the reply signature subsystem will The pre-signature voucher status is stored to the voucher database, and the voucher database provides each of the pre-signature voucher statuses to the voucher status communication protocol server for use by external terminal devices to request credentials.

而本發明亦包含了一種依據前述預測請求流量之憑證預簽系統產生之方法,其步驟主要包含:1.該請求流量預測子系統自該憑證資料庫中取得各該憑證被請求之紀錄;2.該請求流量預測子系統分別依據各該憑證對各該憑證被請求之紀錄依據時段統計出各該憑證的各時段流量,以依據憑證的各時段流量排序以挑選出高請求流量的各該憑證;3.該請求流量預測子系統分別依據挑選出的各該憑證隨機建立各該類神經網路以進行預測各該憑證的被請求流量;4.該請求流量預測子系統依據各該憑證被請求之紀錄訓練各該類神經網路,該請求流量預測子系統並分析各該類神經網路的預測準確度以保留高準確度的各該類 神經網路;5.該請求流量預測子系統依據各該類神經網路之預測產生該請求流量預測值並傳輸至該回覆簽章子系統;6.該回覆簽章子系統接收該請求流量預測值,並依據該請求流量預測值對相應數量的各該憑證預簽章以產生各該預簽章憑證狀態;以及7.該回覆簽章子系統將各該預簽章憑證狀態儲存至該憑證資料庫以備外部終端設備取用。 The present invention also includes a method for generating a voucher pre-signing system according to the foregoing predicted request flow, the steps of which mainly include: 1. The request traffic prediction subsystem obtains a record of each voucher being requested from the voucher database; The request traffic prediction subsystem separately counts the traffic of each voucher according to the time period in which each voucher is requested for each voucher, and sorts the traffic according to each time slot of the voucher to select each voucher of the high request traffic. 3. The request traffic prediction subsystem randomly establishes each of the neural networks according to the selected each of the credentials to predict the requested traffic of each of the credentials; 4. The request traffic prediction subsystem is requested according to each of the credentials. The record trains each of these neural networks, which requests the traffic prediction subsystem and analyzes the prediction accuracy of each such neural network to preserve the high accuracy of each such class. Neural network; 5. The request traffic prediction subsystem generates the requested traffic prediction value according to the prediction of each of the neural networks and transmits the predicted traffic to the reply signature subsystem; 6. The reply signature subsystem receives the requested traffic prediction And pre-signing the corresponding number of the voucher according to the requested traffic prediction value to generate each of the pre-signed voucher states; and 7. the reply signature subsystem stores the pre-signature voucher status to the voucher The database is available for external terminal devices.

而該請求流量預測子系統為了進一步訓練各該類神經網路,該請求流量預測子系統可進行請求流量分群方法以將歷史的請求流量資料分群再輸入訓練,該請求流量分群係為該請求流量預測子系統將依據時段統計後的各該憑證的各時段流量數據化為群集,並計算且逐步將群集合併,所述請求流量分群方法主要包含下列步驟:1.設定初始群集步驟,係將各該憑證請求和查詢之紀錄中任一憑證的每個時點之請求流量紀錄視為一請求流量集合,並以單一時段中之所有集合作為一群集;2.計算標準差步驟,係計算前述群集內部各請求流量集合之標準差;3.計算距離步驟,係計算前述群集之間的請求流量集合之距離;4.計算距離標準差步驟,係計算前述群集之間的請求流量集合之距離的標準差;5.相似群集合併步驟,係在前述群集中有一群集符合內部標準差大於該群集與另一群集之間距離的標準差之狀況下,將該群集與該另一群集合併,並計算群集合 併後之群集中心;以及6.重複合併步驟,係重複前述相似群集合併步驟直至無有群集符合可合併之狀況。 In order to further train each of the neural networks, the request traffic prediction subsystem may perform a request traffic grouping method to group the historical request traffic data into the training, and the request traffic grouping is the request traffic. The prediction subsystem dataizes the traffic of each time period of each voucher according to the time period into a cluster, and calculates and gradually merges the clusters. The request traffic grouping method mainly includes the following steps: 1. setting an initial clustering step, each of which will be The request flow record of each credential in the voucher request and the query record is regarded as a request traffic set, and all the sets in a single time period are used as a cluster; 2. The standard deviation step is calculated, and the foregoing cluster is calculated The standard deviation of each request traffic set; 3. The calculation distance step is to calculate the distance of the request traffic set between the clusters; 4. The calculation distance standard deviation step is to calculate the standard deviation of the distance of the request traffic set between the clusters. ;5. Similar cluster consolidation step, in a cluster in the foregoing cluster, the internal standard deviation is greater than the In the case of a standard deviation of the distance between the cluster and another cluster, merge the cluster with the other cluster and calculate the cluster set And then the cluster center; and 6. Repeat the merge step, repeating the aforementioned similar cluster merge steps until no clusters meet the mergeable condition.

如前所述,該請求流量預測子系統用以產生該請求流量預測值之請求流量預測方法,更可分列詳述如下:首先,可以將請求流量預測方法分為兩階段,分別為訓練階段以及實施階段,其中,訓練階段可以包含兩個步驟:1.隨機產生複數個類神經網路:主要係通過設定隨機類神經網路群演算法參數值,並向憑證資料庫讀取憑證狀態請求查詢紀錄之歷史資料,以隨機建立r個類神經網路模型;2.保留複數個預測正確率高的類神經網路:將隨機產生之r個類神經網路模型的預測準確度與一準確度門檻值進行比對,以排除低於準確度門檻值之類神經網路模型,保留g個正確率的類神經網路;而若無任何類神經網路模型之正確率高於準確度門檻值時,將回到第1個步驟,重新設定門檻值,並重新訓練隨機類神經網路。其中,實施階段亦可以包含兩個步驟:1.輸入即時資料至訓練階段中所保留之預測正確率高的類神經網路:取得即時的憑證狀態請求查詢紀錄,並且依此輸入至訓練階段所保留的g個類神經網路模型,進行預測計算;2.加權平均以產生預測值:最後,該請求流量預測子系統將保留下的各該類神經網路各自產生之預測值,運用訓練階段時所得到之正確率作為權重,進行權重平 均後以產生該請求流量預測值。 As described above, the request traffic prediction subsystem is configured to generate a request traffic prediction method for requesting traffic prediction values, which can be further described as follows: First, the request traffic prediction method can be divided into two phases, respectively, a training phase. And the implementation phase, wherein the training phase can include two steps: 1. randomly generating a plurality of neural networks: mainly by setting a random neural network group algorithm parameter value and reading the voucher status request to the voucher database Query historical records of records to randomly establish r neural network models; 2. Retain multiple neural networks with high prediction accuracy: predict accuracy and accuracy of randomly generated r-like neural network models The thresholds are compared to exclude neural network models below the threshold of accuracy, and g-like neural networks are retained. If the accuracy of any neural network-free model is higher than the accuracy threshold When the value is returned, it will return to the first step, reset the threshold, and retrain the random neural network. The implementation phase can also include two steps: 1. Entering the real-time data to the neural network with high prediction accuracy retained in the training phase: obtaining an instant voucher status request query record, and inputting to the training phase according to this Preserved g-like neural network models for predictive computation; 2. Weighted average to produce predicted values: Finally, the request traffic prediction subsystem will retain the predicted values generated by each of these neural networks, and apply the training phase. The correct rate obtained at the time as a weight, the weight is flat Both are used to generate the requested traffic prediction value.

如上述的預測請求流量之憑證預簽系統及方法,其中,該回覆簽章子系統是實施了憑證狀態預簽章方法以進行預簽章,其主要也可分為四個步驟: The above-mentioned voucher pre-signing system and method for predicting request traffic, wherein the reply signature subsystem implements a voucher status pre-signature method for pre-signature, which can also be mainly divided into four steps:

1.接收等待預簽章之憑證資訊:回覆簽章子系統可接收憑證資訊和前述的請求流量預測值。 1. Receiving the voucher information waiting for the pre-signature: the reply signature subsystem can receive the voucher information and the aforementioned predicted traffic prediction value.

2.偵測離峰時段:為了節省系統資源並降低高峰時段的負載,該回覆簽章子系統向該憑證資料庫取得各該憑證被請求之紀錄以統計分析出各該憑證被請求次數較少的離峰時段,並可以於離峰時段時對憑證狀態進行預簽章,以達到分流之效果。 2. detecting the off-peak period: in order to save system resources and reduce the load during peak hours, the reply signature subsystem obtains a record of each requested voucher from the voucher database to statistically analyze that each voucher is requested less frequently The off-peak period, and can pre-sign the voucher status during the off-peak period to achieve the effect of the diversion.

3.對憑證狀態產製簽章值:對該請求流量預測值所預測出之複數憑證預簽章相應數量的各該憑證以產生複數預簽章憑證狀態。 3. For the voucher status production signature value: the corresponding number of voucheres are pre-signed for the plurality of voucher predicted by the predicted traffic flow value to generate a plurality of pre-signed voucher status.

4.儲存預簽章憑證狀態:將預簽章憑證狀態之資料儲存至憑證資料庫,供後續客戶端設備查詢使用。 4. Store pre-signature voucher status: Store the data of the pre-signature voucher status to the voucher database for subsequent client device query.

如前所述,可知本發明詳細為一種根據歷史資料預測請求流量,並進行憑證預簽的系統以及其方法,當可預先對使用量大之憑證進行預簽處理,並一再訓練進化預測之準確率,係為高效率憑證管理系統之重要一環。 As described above, it can be seen that the present invention is a system for predicting request traffic based on historical data, and for pre-signing a voucher, and a method thereof, when pre-signing the voucher with a large amount of usage, and training the evolution prediction again and again Accuracy is an important part of a highly efficient voucher management system.

100‧‧‧客戶端設備 100‧‧‧Client equipment

101‧‧‧線上憑證狀態通訊協定伺服器 101‧‧‧Online Voucher Status Protocol Server

102‧‧‧請求流量預測子系統 102‧‧‧Request Traffic Prediction Subsystem

103‧‧‧憑證資料庫 103‧‧‧Voucher database

104‧‧‧回覆簽章子系統 104‧‧‧Reply signature subsystem

S201~S205‧‧‧步驟流程 S201~S205‧‧‧Step procedure

S301~S307‧‧‧步驟流程 S301~S307‧‧‧Step procedure

S401~S402‧‧‧步驟流程 S401~S402‧‧‧Step procedure

S4011~S4012‧‧‧步驟流程 S4011~S4012‧‧‧Step process

S4021~S4022‧‧‧步驟流程 S4021~S4022‧‧‧Step procedure

S601~S602‧‧‧步驟流程 S601~S602‧‧‧Step procedure

S701~S704‧‧‧步驟流程 S701~S704‧‧‧Step procedure

圖1為本發明預測請求流量之憑證預簽系統之整體系統 架構示意圖。 1 is an overall system of a voucher pre-signing system for predicting request traffic according to the present invention Schematic diagram of the architecture.

圖2為本發明預測請求流量之憑證預簽方法之步驟流程示意圖。 FIG. 2 is a schematic flow chart of steps of a method for pre-signing a voucher for predicting request traffic according to the present invention.

圖3為本發明中請求流量分群方法之步驟流程示意圖。 FIG. 3 is a schematic flow chart of steps of a method for requesting traffic grouping according to the present invention.

圖4為本發明中請求流量預測方法之步驟流程示意圖。 FIG. 4 is a schematic flow chart showing the steps of the method for requesting traffic prediction according to the present invention.

圖5為本發明中請求流量預測方法以類神經網路模型1為實例之示意圖。 FIG. 5 is a schematic diagram of a method for requesting traffic prediction according to a neural network model 1 of the present invention.

圖6為本發明中請求流量預測方法之實施階段舉一實例的步驟流程示意圖。 FIG. 6 is a schematic flow chart showing an example of an implementation stage of a request traffic prediction method according to the present invention.

圖7為本發明中請求流量預測方法中憑證狀態預簽章方法之步驟流程示意圖。 FIG. 7 is a flow chart showing the steps of a method for pre-signing a voucher state in a request traffic prediction method according to the present invention.

以下將以實施例結合圖式對本發明進行進一步說明。 The invention will be further illustrated by the following examples in conjunction with the drawings.

本發明詳細來說是一種根據請求流量預測的線上憑證狀態通訊協定(Online Certificate Status Protocol,OCSP)預簽方法與系統;有鑒於習知技術中憑證狀態通訊協定的方法運作上仍主要採用即時線上查詢以及回覆的方式,但由於回覆簽章子系統在簽章時將可能花費許多處理時間,故習知技術之方法將造成回覆客戶端設備時有所延宕,另外,隨著請求流量增加,將逐漸對憑證狀態通訊協定伺服器和回覆簽章子系統造成負擔,接著在系統無法負荷時即會發生當機情事。 The present invention is a detailed online certificate status protocol (OCSP) pre-signing method and system according to the request traffic prediction; in view of the prior art, the method of the voucher status communication protocol still operates mainly on the live line. The way of querying and replying, but since the reply signature subsystem will take a lot of processing time when signing, the method of the prior art will cause delays in replying to the client device, and in addition, as the request traffic increases, Gradually burdening the voucher status protocol server and the reply signing subsystem, and then crashing when the system is unable to load.

此外目前習知技術中,網路流量預測方法一般需要經過大量統計過程後得出,而由於用戶的請求流量變異程 度較大,故利用習知技術所得出的請求流量估計誤差將可能較大。 In addition, in the prior art, the network traffic prediction method generally needs to be obtained after a large number of statistical processes, and the user requests the traffic variation process. The degree of the request flow estimation error obtained by using the prior art may be large.

故本發明主要係收集和分析各個憑證在一日的每個時段的被請求流量之集合,再運用將請求流量分群方法將相似時段的請求流量結合為一群,將資料分為複數個群組,後續再各別依不同的群組運用將請求流量預測方法進行預測,最後再按照請求流量預測值對該憑證狀態簽章,以取得較準確的預簽章憑證狀態數量,並達成回覆簽章子系統之負載平衡。 Therefore, the present invention mainly collects and analyzes the set of requested traffic of each voucher in each time of day, and then combines the requested traffic of the similar time period into a group by using the request traffic grouping method, and divides the data into a plurality of groups. Subsequent different groups use the request traffic prediction method to predict, and finally sign the voucher status according to the requested traffic prediction value to obtain a more accurate pre-signature voucher status quantity, and reach a reply signature Load balancing of the system.

首先,請參照圖1所示,本發明之系統包含至少一個客戶端設備100、一線上憑證狀態通訊協定(OCSP)伺服器101、一回覆簽章子系統104、一憑證資料庫103、以及一請求流量預測子系統102,其相互運作之模式及步驟將在後段中詳細敘述;再請同時參照下列表一,表一係為以一實施例舉出2014/07/01到2014/07/28之期間的憑證請求查詢紀錄,若配合圖1以舉例,其中,當複數個客戶端設備100中之一客戶端設備D1於2014/07/01日的00:00:29時欲確認憑證C1狀態時,發出請求至線上憑證狀態通訊協定伺服器101,並由線上憑證狀態通訊協定伺服器101向憑證資料庫103查詢和取得憑證C1狀態,且在憑證資料庫103中留下請求查詢紀錄,即如表一之中的第一行所示之資料,而該線上憑證狀態通訊協定伺服器101後續再將憑證C1狀態傳送至回覆簽章子系統104進行簽章,以及將簽章後的憑證C1狀態回覆給客戶端設備100中的客戶端設備D1,以完成整個憑證要求及簽章之動作;依此類推下,每個客戶端設備將針對本身所需求的憑證進行查詢,並且其每筆請求查詢紀錄在憑證資料庫中將分別 被儲存。 First, referring to FIG. 1, the system of the present invention includes at least one client device 100, an online certificate status communication protocol (OCSP) server 101, a reply signature subsystem 104, a voucher database 103, and a The request traffic prediction subsystem 102, the modes and steps of its mutual operation will be described in detail in the following paragraph; please refer to the following list 1 and Table 1 for an example to illustrate 2014/07/01 to 2014/07/28 The voucher request query record during the period, if exemplified by FIG. 1, wherein one of the plurality of client devices 100 is required to confirm the credential C1 status when 00:00:29 on 2014/07/01 At this time, the request is sent to the online voucher status communication protocol server 101, and the online voucher status communication protocol server 101 queries and obtains the voucher C1 status from the voucher database 103, and leaves a request inquiry record in the voucher database 103, that is, As shown in the first row of Table 1, the online voucher status communication protocol server 101 subsequently transmits the voucher C1 status to the reply signature subsystem 104 for signature, and the signed certificate C1. shape Responding to the client device D1 in the client device 100 to complete the entire voucher request and signature action; and so on, each client device will query for the voucher required by itself, and each request is queried. The record will be in the voucher database Stored.

本發明之方法可將請求查詢紀錄集合依週期和時段分別統計,即請求流量預測子系統102將表一所示整體2014/07/01~2014/07/28期間之憑證被請求查詢紀錄為例之集合再進行統計計算,以計算出須預簽章之憑證狀態數量並傳輸至回覆簽章子系統104,並由回覆簽章子系統104進行預簽章憑證狀態儲存至憑證資料庫103;而當客戶端設備100查詢之憑證已經具備預簽章憑證狀態時,直接由線上憑證狀態通訊協定伺服器101向憑證資料庫103查詢和取得經過本發明之方法預簽章的憑證狀態,再將預簽章憑證狀態回覆予客戶端設備100,憑證資料庫103並將已被取走的預簽章憑證狀態銷毀。 The method of the present invention can separately count the request query record set according to the period and the time period, that is, the request traffic prediction subsystem 102 takes the document of the whole 2014/07/01~2014/07/28 period shown in Table 1 as the requested query record as an example. The set is further statistically calculated to calculate the number of voucher states to be pre-signed and transmitted to the reply signature subsystem 104, and the pre-signed voucher status is stored by the reply signature subsystem 104 to the voucher database 103; When the certificate queried by the client device 100 already has the status of the pre-signature voucher, the online voucher status communication protocol server 101 directly queries and obtains the voucher status of the pre-signed certificate by the method of the present invention. The signature voucher status is replied to the client device 100, the voucher database 103 and the pre-signed voucher status that has been removed is destroyed.

下表為表一: The following table is Table 1:

本發明之方法流程如圖2所示,此方法可包含有五個步驟,分別為:步驟S201憑證之請求流量收集與統計、 步驟S202取得高度請求流量的憑證、步驟S203實施請求流量分群方法、步驟S204實施請求流量預測方法、以及步驟S205實施憑證狀態預簽章方法。本方法包含上述步驟之主要目的是於進行請求流量預測方法之前,取得高度請求流量的憑證,並各別對高度請求流量憑證進行統計和預簽章的處理,本方法並可結合請求流量分群方法以針對每個憑證之請求流量記錄依時段進行分群,用於訓練以增加預測正確率,以下,將配合實施例詳細分述各步驟。 The method flow of the present invention is shown in FIG. 2, and the method may include five steps, namely: requesting traffic collection and statistics of the voucher in step S201, Step S202 acquires the certificate of the highly requested flow rate, the step S203 implements the request flow grouping method, the step S204 implements the request flow rate prediction method, and the step S205 implements the voucher state pre-signature method. The method has the above-mentioned steps, the main purpose of which is to obtain the credentials of the highly requested traffic before performing the request traffic prediction method, and separately perform the statistics and pre-signature processing on the highly requested traffic credentials, and the method can be combined with the request traffic grouping method. The request flow records for each credential are grouped according to the time period for training to increase the prediction correctness rate. Hereinafter, the steps will be described in detail in conjunction with the embodiment.

首先係為第一步驟S201,憑證之請求流量收集與統計步驟:本發明之請求流量預測子系統向憑證資料庫取得憑證的請求查詢紀錄,如表一所示之2014/07/01~2014/07/28期間之請求查詢紀錄,請求流量預測子系統依週期(在本實施例中係以週作為週期單位)、時段(在本實施例中係以日作為時段單位)、時點(在本實施例中以小時為時點單位)分別統計每個時點請求查詢紀錄的數量,將可得到複數個週期、複數個時段、複數個時點之請求查詢紀錄集合,如下列表二,是以如表一所舉之紀錄資料整理後所示。 Firstly, the first step S201, the request flow collection and statistics step of the voucher: the request flow prediction subsystem of the present invention obtains the request query record of the voucher from the voucher database, as shown in Table 1 2014/07/01~2014/ The request query record during the period of 07/28, the request traffic prediction subsystem according to the period (in this embodiment, the week is the period unit), the time period (in the present embodiment, the day is used as the time unit), and the time point (in the present embodiment) In the example, the hourly time unit is used to count the number of request query records at each time point, and the request query record set of multiple time periods, plural time periods, and multiple time points can be obtained, as shown in Table 2 below. The records are compiled as shown.

下表為表二: The following table is Table 2:

再來,係為第二步驟S202,係取得高度請求流量的憑證之步驟:如表二所示,取得每個憑證依各個時段的請求查詢紀錄數量後,本發明之請求流量預測子系統將依請求查詢紀錄數量進行由高至低地排序,即可取得排名較前的高度請求流量的憑證,即為較常被請求之憑證,亦可被解釋為本發明可選擇性地針對較需紓解延宕情形之憑證。 Then, in the second step S202, the step of obtaining the certificate of the highly requested traffic is as follows: as shown in Table 2, after obtaining the number of requests for each credential according to the request of each time period, the request traffic prediction subsystem of the present invention will The number of requesting query records is sorted from high to low, and the voucher of the higher ranked request traffic can be obtained, which is the more frequently requested voucher, and can also be interpreted as the invention can selectively delay the need for further decompression. The voucher of the situation.

以前述表一之2014/07/01~2014/07/28期間為例,請求流量預測子系統可得到每個憑證的請求流量總數,再依其請求流量由高到低排序,整理結果可如下列表三所示;即可取出複數個高度請求流量的憑證之資訊以進行後續分析,在此實施例中由於係以憑證C1其請求流量總數為208728次,為最高度請求流量的憑證,故在此實施例中將對憑證C1為例,請求流量預測子系統將進行後續的請求流量分群方法、請求流量預測方法、憑證狀態預簽章方法。 Taking the period from 2014/07/01 to 2014/07/28 in Table 1 above as an example, the request traffic prediction subsystem can obtain the total number of requested flows for each credential, and then sort the traffic according to the requested traffic from high to low. list three shown; to remove the plurality of credentials requested altitude information flow for subsequent analysis, in this embodiment, since the line to which the request credentials C 1 Total flow rate of 208,728 times, the height of the request for the certificate most traffic, so Examples Example C 1 certificate will in this embodiment, the requesting subsystem traffic forecasts for subsequent clustering method request traffic, traffic prediction method requests, pre-signature certificate status method.

表三如下所示: Table 3 is as follows:

再來,係為第三步驟S203,係為實施請求流量分群方法步驟:請求流量預測子系統取得欲分析之憑證各個時段的請求流量集合,初始時將每個時段的請求流量集合視為一個群集,分別計算群內請求流量集合標準差、群間請求流量集合距離、以及群間請求流量集合標準差,再將相似請求流量集合的群集進行合併和重新計算群中心,直至無群集可再合併。 Then, the third step S203 is to implement a request traffic grouping method step: requesting the traffic prediction subsystem to obtain a request traffic set for each period of the credential to be analyzed, and initially treating the request traffic set of each time period as a cluster. Calculate the standard deviation of the request traffic set in the group, the distance between the request traffic sets of the group, and the standard deviation of the request traffic set between the groups, and then merge and recalculate the clusters of the similar request traffic set until no cluster can be merged.

而第四步驟S204係為實施請求流量預測方法步驟:即請求流量預測子系統取得欲分析之憑證各個時段的請求流量集合,並於訓練階段隨機建立複數個類神經網路,再以歷史資料進行訓練和分析各個類神經網路的請求流量預測準確度,並保留複數個準確度高的類神經網路;而在實施階段中,請求流量預測子系統將即時的請求流量集合輸入至訓練階段所保留之複數個準確度高的類神經網路,分別得到請求流量預測值後,再進行加權平均得到最後的請求流量預測值,並將請求流量預測值傳送予一回覆簽章子系統。 The fourth step S204 is to implement the request traffic prediction method step: the request traffic prediction subsystem obtains the request traffic set of each period of the voucher to be analyzed, and randomly establishes a plurality of neural networks in the training phase, and then performs historical data. Train and analyze the accuracy of request traffic prediction for each type of neural network, and retain a plurality of highly accurate class-like neural networks; in the implementation phase, the request traffic prediction subsystem inputs the immediate request traffic set into the training phase. The plurality of highly accurate neural networks are retained, and the predicted traffic prediction values are respectively obtained, and then the weighted average is obtained to obtain the final requested traffic prediction value, and the requested traffic prediction value is transmitted to a reply signature subsystem.

最後,第五步驟S205為實施憑證狀態預簽章方法步驟:回覆簽章子系統接收請求流量預測值,由回覆簽章子系統針對請求流量預測值所預測之待預簽章的憑證資訊產製簽章值,並將預簽章憑證狀態儲存至憑證資料庫;另外,該回覆簽章子系統為了減少流量負載,其可於預簽章前向憑 證資料庫查詢請求流量之時段分佈,以分析出離峰時段,再於負載較小的離峰時間進行預簽章的流程。 Finally, the fifth step S205 is a method for implementing a voucher status pre-signature method: the reply signature subsystem receives the request traffic prediction value, and the voucher information system predicts the voucher information to be pre-signed for the predicted traffic prediction value. Signature value, and store the status of the pre-signature voucher to the voucher database; in addition, in order to reduce the traffic load, the reply signature subsystem can be pre-signed The certificate database queries the time period distribution of the request traffic to analyze the off-peak period and then performs the pre-signature process at the off-peak time with a small load.

而本發明的預測請求流量之憑證預簽方法流程中,包含有前述的請求流量分群方法,其方法之步驟流程圖如圖3所示;主要包含六個步驟,分列如下:步驟S301設定初始群集、步驟S302計算群內請求流量集合之標準差、步驟S303計算群間請求流量集合之距離、步驟S304計算群間請求流量集合距離之標準差計算、步驟S305相似群集合併,並計算群集中心之請求流量集合、以及步驟S306確認是否有群集未計算合併,以重覆計算至無群集可合併,若無則進入步驟S307結束,上述各該步驟將詳細在以下段落中作出解釋。 The flow of the voucher pre-signing method for predicting request traffic of the present invention includes the foregoing request flow grouping method, and the flow chart of the method is as shown in FIG. 3; mainly includes six steps, which are listed as follows: Step S301 sets the initial Clustering, step S302 calculates the standard deviation of the set of request traffic in the group, step S303 calculates the distance of the inter-group request traffic set, step S304 calculates the standard deviation calculation of the inter-group request traffic set distance, similar cluster merging in step S305, and calculates the cluster center The traffic collection is requested, and step S306 confirms whether there is a cluster uncalculated merge to repeat the calculation to no cluster mergeable. If not, the process proceeds to step S307, which will be explained in detail in the following paragraphs.

請求流量分群方法之步驟一S301為設定初始群集:以請求流量預測子系統所被設定之時段單位,請求流量預測子系統將每一個時段單位內每個時點的請求流量集合分別作為一個群集,或是可以將每個週期中同時段之請求流量集合作為一個群集,以計算每個群集的中心。以表三的2014/07/01~2014/07/28期間之請求流量為例,統計後憑證C1之請求流量集合可整理如下列表四所示,其中,憑證C1第1個週期第1個時段(即2014/07/01星期二)第1個時點(即凌晨0時)的請求流量為0,本實施例中表示該請求流量值之邏輯為q 憑證編號,週期編號,時段編號,時點編號,而以同樣之表示方式,憑證C1第4個週期第7個時段(即2014/07/28星期一)第24個時點(即晚上23時)的請求流量為82,而本實施例中更以同一個時段的時點請求流量集合表示為Q 憑證編號,週期編號,時段編號,時點編號,如憑證C1第1個週期第1個時段的請求流量為={,,,...,}={0,0,...,99}。 Step 1 of the requesting traffic grouping method is to set an initial cluster: the requesting traffic prediction subsystem sets the request traffic set of each time point in each time slot unit as a cluster, or It is possible to aggregate the requested traffic of simultaneous segments in each cycle as a cluster to calculate the center of each cluster. Taking the request traffic of the period from 2014/07/01 to 2014/07/28 in Table 3 as an example, the set of request traffic of the certificate C1 can be sorted as shown in the following list four, wherein the first cycle of the first cycle of the certificate C 1 Request flow at the first time (ie 0:00 am) for the time period (ie Tuesday, July 24, 2014) 0, in this embodiment, the logic indicating the requested flow value is q document number, cycle number, time slot number, time point number , and in the same way, the seventh period of the fourth cycle of the certificate C 1 (ie 2014/) Monday, 07/28) Request traffic at the 24th time (ie at 23:00 pm) It is 82, and in this embodiment, the set of time request traffic in the same time period is represented as a Q document number, a cycle number, a time slot number, a time point number , and the request flow rate of the first time period of the first cycle of the certificate C 1 is ={ , , ,..., }={0,0,...,99}.

表四如下所示: Table 4 is as follows:

在此實施例中,本發明之請求流量預測子系統所被設定之時段單位共有n個週期、m個時段、o個時點,系統可以將每個週期中同一時段之請求流量集合群聚成一個群集,若以星期二為例,可將第1週星期二07/01、第2週星期二07/08、第3週星期二07/15、第4週星期二07/22之請求流量集合群聚成一個群集,即將聚為一個群集,並且運用下列公式(1)舉例之方式計算群中心,計算結果舉例如公式(2)所示;依此類推逐一計算,可得以每個週期中同時段為基礎的群中心,分別表示為、…、,結果如下表五所示。 In this embodiment, the time period unit set by the request traffic prediction subsystem of the present invention has n cycles, m time slots, and o time points, and the system can aggregate the request traffic sets of the same time period in each cycle into one. For clustering, for example, on Tuesday, the request traffic collection on the first week of Tuesday 07/01, the second week of Tuesday 07/08, the third week of Tuesday 07/15, and the fourth week of Tuesday 07/22 can be clustered into one cluster. Coming soon , , , Gather into a cluster and calculate the group center using the following formula (1) as an example The calculation result is shown, for example, in the formula (2); and by the same calculation, the group center based on the simultaneous segment in each cycle can be expressed as , ,..., The results are shown in Table 5 below.

公式(1)如下所示,其係舉例計算C1憑證第j個週期內之群中心;其中,係代表C1憑證第j個週期第1個時段的群中心,以下相同型式之表示,其邏輯則以此類推: (1) shown below formula, which is calculated based group for example C 1 voucher center within the j-th cycle; wherein, Representative groups based document center C 1 of the j th cycle of the first period, the same type of said logical notations:

而據上述公式(1)之舉例計算,計算C1憑證第1個週期之群中心的結果之公式(2)如下所示: 其中,每個值係代表第1週期內各時段的群中心,以下將以此類推。 According to the example of the above formula (1), the formula (2) for calculating the result of the group center of the first cycle of the C 1 certificate is as follows: Among them, each value represents the group center of each time period in the first cycle, and so on.

表五如下所示: Table 5 is as follows:

請求流量分群方法之步驟二S302為計算群內請求流量集合之標準差:請求流量預測子系統計算每個群集內請求流量集合的標準差值;在本實施例中將以下列的公式(3)舉例,以此類推分別計算群集內部請求流量集合的標準差值,計算之結果如下列表六所示。 Step 2: S302 is a standard deviation of the set of request traffic in the group: the request traffic prediction subsystem calculates a standard deviation of the set of request traffic in each cluster; in the embodiment, the following formula (3) is used. For example, the standard deviation of the set of request traffic within the cluster is calculated separately, and the result of the calculation is shown in the following table 6.

公式(3)如下所示,其中σ表示標準差,μ表示平均數,本公式係計算C1憑證第1個週期群集內集合之標準差:,其中,Equation (3) is as follows, where σ represents the standard deviation and μ represents the average. This formula calculates the standard deviation of the set in the first cycle of the C 1 certificate: ,among them, .

表六如下所示: Table 6 is as follows:

請求流量分群方法之步驟三S303為計算群集間請求流量集合之距離:請求流量預測子系統計算以前述週期或時段等分類的各個群集與其他的群集間之請求流量集合的距離值或相似度值;在本實施例中,係運用下列公式(4)分別計算群集間請求流量集合每個時點向量值的距離值;而如表七所示,係以群中心與其他群集間距離計算結果為例。 Step 3: S303 is a distance for calculating a set of inter-cluster request traffic: the request traffic prediction subsystem calculates a distance value or a similarity value of a request traffic set between each cluster and other clusters classified by the foregoing period or time period, and the like. In the present embodiment, the following formula (4) is used to calculate the distance value of each time point vector value of the inter-cluster request traffic set. And as shown in Table 7, Take the calculation result of distance from other clusters as an example.

公式(4)如下所示,公式之意義在計算C1憑證第j個週期群集群中心與C1憑證第a個週期群集群中心的距離值: Equation (4) shown below significance, the calculation equation of the j-th certificate C 1 cycle cluster groups with C 1 voucher center of a cluster to the cluster center cycle distance value:

表七如下所示,係計算群中心與其他群集間之間距離的結果: Table 7 is shown below, is the calculation group center With other clusters The result of the distance between:

請求流量分群方法之步驟四S304為群間請求流量集合距離之標準差計算:請求流量預測子系統計算每個群集與其他群集間請求流量集合距離之標準差值;在本實施例中將以下列公式(5)分別計算群集間請求流量集合距離的標準差值,如表八所示,係以群中心與其他群集間距離之計算結果為例來計算標準差。 The step S304 of the request traffic grouping method is a standard deviation calculation of the inter-group request traffic set distance: the request traffic prediction subsystem calculates a standard deviation of the request traffic set distance between each cluster and other clusters; in this embodiment, the following Equation (5) calculates the standard deviation of the set traffic distance between clusters respectively. As shown in Table 8, the group center With other clusters The calculation result of the distance is taken as an example to calculate the standard deviation.

公式(5)如下所示: 其中,Equation (5) is as follows: among them, .

表八如下所示,係計算群中心與其他群集間之間距離的標準差值的結果: Table 8 is shown below, is the calculation group center With other clusters The result of the standard deviation between the distances:

請求流量分群方法之步驟五S305為相似群集合併並計算群集中心之請求流量集合:請求流量預測子系統判斷前述群集內部請求流量集合的標準差值以及該群集與另一個群集間請求流量集合距離的標準差值,若群集內部請求流量集合的標準差值大於該群集與另一個群集間請求流量集合距離的標準差值,此時,判斷該群集與另一個群集係為相似之群集,故將該兩群集進行合併且計算合併後群集之中心。在本實施例中,可以觀察到群中心為與群中心為之群集間的標準差值相對最小(標準差值為40.74),且群中心之群集的標準差值,故可判斷群中心之群集與群中心為為相似群集,將進行合併把群中心之群集併入至群中心為之群集,且運用下列公式(6)之範例計算合併後群集之中心,以得到新的群中心,作,並將被合併的 群中心之群集刪除,其結果如下列表九所示。 Step 5: Requesting a Traffic Clustering Method S305 merges and computes a clustered request traffic set for a similar cluster: the request traffic prediction subsystem determines a standard difference value of the cluster internal request traffic set and a distance between the cluster and another cluster request traffic set. The standard deviation, if the standard deviation of the set of request traffic within the cluster is greater than the standard deviation of the set traffic distance between the cluster and another cluster, then the cluster is judged to be similar to another cluster, so The two clusters merge and calculate the center of the merged cluster. In this embodiment, it can be observed that the group center is With the group center The standard deviation between clusters is relatively small (standard deviation is 40.74), and the group center Standard deviation of the cluster Therefore, the group center can be judged Cluster and group center For similar clusters, will be merged into the cluster center The cluster is merged into the group center Cluster, and use the following formula (6) to calculate the center of the merged cluster to get a new cluster center. And will be merged into the group center The cluster is deleted and the results are shown in the following list nine.

公式(6)如下所示,係為將群中心為之群集合併入群中心為之群集之計算方式,其中,為表示第1週期群中心計算前後間的差異,在下列公式及表中係以代表合併後之第1週期群中心: The formula (6) is as follows, the group center is The cluster is merged into the group center The calculation method of the cluster, in which the difference between before and after the calculation of the group center of the first period is performed in the following formulas and tables. Representing the first cycle group center after the merger:

表九如下所示,係計算2014/07/01~2014/07/28期間統計後之憑證C1請求流量經第一回合合併後群中心,其中各欄表示在第一欄為群中心之群集,其各時段之群中心: Table 9 is as follows. It is calculated that the certificate C 1 request traffic after the period of 2014/07/01~2014/07/28 is merged and the group center is merged in the first round. The columns indicate the cluster in the first column as the group center. , the group center of each time period:

請求流量分群方法之步驟六S306為確認是否有群集未計算合併,以重覆計算至無群集可合併:請求流量預測子系統將重複計算每個群集其群集內請求流量集合之標準差、群集間請求流量集合之距離、以及群集間請求流量集合 距離之標準差,以進行相似群集的合併,且計算新群集中心之請求流量集合,直至沒有相似群集可以被合併時即停止,即為進入步驟S307結束。 Step 6 of requesting traffic grouping method to confirm whether there is a cluster uncalculated merge, to repeatedly calculate to no cluster can be merged: the request traffic prediction subsystem will repeatedly calculate the standard deviation of the clustered request traffic set of each cluster, between clusters Request traffic collection distance, and inter-cluster request traffic collection The standard deviation of the distances is used for merging of similar clusters, and the set of request traffic for the new cluster center is calculated until no similar clusters can be merged, that is, the process proceeds to step S307.

在本實施例中,在發生如前列表九中,群中心為群集與群中心之群集合併後,將再依標準差值之大小順序,依序的對群中心群集與群中心為群集合併(此時之係代表經合併過之原第1暨第7週期群中心,未免經過多次合併運算後出現過於複雜難辨之符號表示,爾後經每步驟合併後之第1暨第X週期群中心皆表示為,唯其所代表之意義不同);合併後,再進行新群中心群集與群中心群集合併、以及新群中心群集與群中心群集合併;經上述合併步驟後,由於群中心之群集與群中心之群集與其他群集之距離皆過大(距離並未小於其內部標準差值),所以可判對斷各該群集各自為獨立之一群,最後,完成全部的合併運算後,可將原本的7個群集合併分為3群。其為:週期內星期一至五可分為一群集,星期六為一獨立群集,且星期日亦為一獨立群集。 In this embodiment, in the occurrence of the foregoing list 9, the group center is Cluster and group center After the cluster is merged, it will be based on the standard deviation. Order of size Cluster and cluster center Cluster merge (in this case It represents the original 1st and 7th cycle group centers that have been merged. It is inevitable that after many mergers, the symbolic representation is too complicated and difficult to distinguish. After the merger, the 1st and Xth cycle group centers are represented as , only the meaning it represents is different); after the merger, the new group center Cluster and group center Cluster consolidation, and new cluster center Cluster and group center Cluster merge; after the above merge step, due to the cluster center Cluster and group center The distance between the cluster and other clusters is too large (distance is not less than its internal standard deviation), so it can be judged that each cluster is independent of one group, and finally, after completing all the merge operations, the original 7 can be The cluster is merged into 3 groups. It is: a cluster can be divided into a cluster from Monday to Friday, a separate cluster on Saturday, and a separate cluster on Sunday.

另外,本發明之請求流量分群方法亦得使用在以每個時段同時點為基礎之群中心方式上進行分群,在本實施例中,將可得出凌晨0時至6時可分為一群集,而6時至24時則為另一群集,接著,本發明之請求流量預測子系統將可依分群之後的結果資料,用以訓練請求流量預測方法之複數個類神經網路模型,以提升系統的預測正確率。 In addition, the request traffic grouping method of the present invention is also used to perform grouping on a group center mode based on simultaneous points in each period. In this embodiment, it can be concluded that the cluster can be divided into a cluster from 0:00 to 6:00. And 6:00 to 24:00 is another cluster. Then, the request traffic prediction subsystem of the present invention can use the result data after the grouping to train a plurality of neural network models of the request traffic prediction method to improve The prediction accuracy rate of the system.

至此,進入步驟S307結束後,本發明的請求流量分群方法步驟實施過程即結束。 So far, after the end of step S307, the step of implementing the request flow grouping method step of the present invention ends.

而本發明的預測請求流量之憑證預簽方法流程中,包含有前述的請求流量預測方法,其方法之步驟流程圖如圖4所示,主要將包含兩個階段,分別為訓練階段S401和實施階段S402,將詳細分述如下。 The flow of the voucher pre-signing method for predicting request traffic of the present invention includes the foregoing request traffic prediction method, and the flow chart of the method is shown in FIG. 4, which mainly includes two phases, namely, training phase S401 and implementation. Stage S402 will be described in detail as follows.

在訓練階段S401主要可包含兩個步驟:步驟S4011隨機產生複數個類神經網路、步驟S4012保留複數個預測正確率高的類神經網路。 In the training phase S401, the method may include two steps: step S4011 randomly generates a plurality of neural networks, and step S4012 retains a plurality of neural networks with high prediction accuracy.

其中,訓練階段S401中之步驟S4011隨機產生複數個類神經網路係為:請求流量預測子系統可被設定隨機類神經網路群演算法之參數值,且請求流量預測子系統向憑證資料庫讀取憑證被請求查詢紀錄的歷史資料,以隨機建立r個類神經網路模型。 Wherein, step S4011 in the training stage S401 randomly generates a plurality of neural network systems: the request traffic prediction subsystem can be set to a parameter value of the stochastic neural network group algorithm, and request the traffic prediction subsystem to the voucher database The voucher is requested to query the historical data of the record to randomly establish r neural network models.

首先,由開發人員設定請求流量預測子系統中之隨機類神經網路群演算法的相關參數值,包含有建立類神經網路模型之數量(以r個為例)、類神經網路模型中隱藏層最大數量(以h max 個為例)、類神經網路模型中每個隱藏層最大神經元數量(以c max 個為例)、訓練類神經網路模型的訓練資料數佔總訓練階段資料數的比例(後續說明將以ρ%為例)、以及正確率門檻值(以w threshold 為例);在本實施例中,將設定共建立10個類神經網路模型(即r=10)、類神經網路模型中隱藏層最大數量為5(即h max =5)、類神經網路模型中每個隱藏層最大神經元數量為7(即c max =7)、訓練類神經網路模型的訓練資料數佔總訓練階段資料數的比例為60%(即ρ%=60%)、以及正確率門檻值為0.945(即w threshold =0.945,即為94.5%),本實施例將依 前述參數值以產生10個類神經網路模型以進行請求流量預測。 First, the developer sets the relevant parameter values of the stochastic neural network group algorithm in the request traffic prediction subsystem, including the number of established neural network models (in the case of r ), and the neural network model. The maximum number of hidden layers (taking h max as an example), the number of maximum neurons in each hidden layer in the neural network model (taking c max as an example), and the number of training data in the training neural network model accounted for the total training phase. The ratio of the number of data (the following description will take ρ% as an example) and the threshold of the correct rate (taking w threshold as an example); in this embodiment, a total of 10 neural network models will be set up (ie, r = 10). The maximum number of hidden layers in the neural network model is 5 (ie, h max = 5), and the number of largest neurons in each hidden layer in the neural network model is 7 (ie, c max = 7), training neural network. The ratio of the training data of the road model to the total number of training data is 60% (ie, ρ%=60%), and the correct rate threshold is 0.945 (ie, w threshold = 0.945, which is 94.5%). This embodiment will Based on the aforementioned parameter values to generate 10 neural network models for request traffic prediction.

本實施例中,將以憑證C1被請求流量為例來進行說明;首先,請求流量預測子系統向憑證資料庫讀取憑證狀態請求查詢紀錄之歷史資料(即表四所示之資料),如第1個週期第1個時段(即2014/07/01星期二)的請求流量集合為={,,,...,}={0,0,...,99}。且在此資料集合的下一個時段之請求流量集合的總和為10537,故開發人員將設定輸入值為時段請求流量集合,而目標輸出值則應為該輸入時段之下一個時段的請求流量集合的總和值10537。另外,若在此之前有進行過請求流量分群方法,則依群集各別進行隨機類神經網路群演算法之訓練和計算。 In this embodiment, the requested traffic of the credential C 1 is taken as an example for description; first, the request traffic prediction subsystem reads the voucher status request query history data (ie, the data shown in Table 4) to the voucher database, The set of request traffic for the first period of the first period (ie, Tuesday, July 24, 2014) is ={ , , ,..., }={0,0,...,99}. And the sum of the request traffic collections in the next time period of this data collection is 10537, so the developer will set the input value to the time period request traffic collection. And the target output value should be the sum value 10537 of the set of request traffic for a period below the input period. In addition, if the request traffic grouping method has been performed before, the training and calculation of the stochastic neural network group algorithm are performed separately according to the cluster.

依據前述被設定之隨機類神經網路群演算法參數值,請求流量預測子系統應隨機產生10個類神經網路模型,且因為被設定之類神經網路模型中隱藏層最大數量為5且類神經網路模型中每個隱藏層最大神經元數量為7,意即每個類神經網路模型之隱藏層數量必須要介於0至5層,且每個隱藏層的神經元數量將介於0至7個,本實施例根據設定所產生之結果如下表十所示。 According to the parameter values of the stochastic neural network group algorithm set, the request traffic prediction subsystem should randomly generate 10 neural network models, and the maximum number of hidden layers in the neural network model is 5 and The number of neurons in each hidden layer in the neural network model is 7, which means that the number of hidden layers in each type of neural network model must be between 0 and 5, and the number of neurons in each hidden layer will be From 0 to 7, the results produced by the present embodiment according to the settings are shown in Table 10 below.

表十如下所示: Table 10 is as follows:

另外,見表十時請同時參考圖5,其為以類神經網路模型1為例之一示意圖,類神經網路模型1之隱藏層為1層(第二欄位之隱藏層數),該層隱藏層之神經元數為2個(第三欄位之神經元數集合{2});類神經網路模型2之隱藏層有2層,其中第1層隱藏層之神經元數為3個,而第2層隱藏層之神經元數有4個(第三欄位之神經元數集合{3,4});依此類推,以得出全部共10個類神經網路模型。並且,由於設定的訓練類神經網路模型的訓練資料數佔訓練階段資料總筆數的60%,若以表四為例來說,訓練階段資料數之總筆數為20筆,所以每一個類神經網路模型將隨機取出12筆資料作為訓練類神經網路模型學習使用,而剩餘之8筆訓練階段中的測試資料(Testing Data in Training Stage,TDTRS)將分別作為本訓練階段時每個類神經網路模型以驗證使用;在本步驟中,每個類神經網路模型所取得的12筆資料之集合皆各自隨機產生,每一個類神經網路模型都將取得不同的資料集合以反覆進行訓練和學習。 In addition, see Table 10, please also refer to Figure 5, which is a schematic diagram of the neural network model 1 as an example. The hidden layer of the neural network model 1 is 1 layer (the hidden layer number of the second field). The number of neurons in the hidden layer of this layer is 2 (the set of neuron numbers in the third column {2}); the hidden layer of the neural network model 2 has 2 layers, and the number of neurons in the hidden layer of the first layer is 3, and the number of neurons in the hidden layer of the 2nd layer is 4 (the set of neuron numbers in the third column {3, 4}); and so on, to obtain a total of 10 neural network models. Moreover, since the number of training materials of the set training neural network model accounts for 60% of the total number of data in the training phase, if Table 4 is taken as an example, the total number of data in the training phase is 20, so each one The neural network model will randomly take 12 samples of data for training neural network model learning, and the remaining 8 training stages (Testing Data in Training Stage, TDTRS) will be used as the training phase. The neural network model is used for verification; in this step, each set of 12 data obtained by each type of neural network model is randomly generated, and each type of neural network model will obtain different data sets to be repeated. Train and learn.

當完成前述所有類神經網路模型的訓練後,請求流量預測子系統可運用剩餘之8筆資料來進行每個類神經網路模型的驗證,用以計算平均正確率來作為每個類神經網路模型之權重;以類神經網路模型1為例,將訓練階段中的測試資料全部輸入至訓練後的類神經網路模型1中以計算出正確率。例如:請求流量集合輸入時,將得出預測值為10911,接著以下式計算出正確率,式子為1-(|正確值-預測值|/正確值),結果為1-(|10537-10911|/10537)=96.45%;依此方 法類推計算,可得出8筆訓練階段中的測試資料(TDTRS)之正確率,進而計算出平均正確率,在本實施例中類神經網路模型1平均正確率為93.23%。而全部10個類神經網路模型所對應之平均正確率分列如下,如表十一所示。 After completing the training of all the above-mentioned neural network models, the request traffic prediction subsystem can use the remaining 8 data to verify each type of neural network model to calculate the average correct rate as each type of neural network. The weight of the road model; taking the neural network model 1 as an example, all the test data in the training phase are input into the trained neural network model 1 to calculate the correct rate. For example, when requesting traffic set input, the predicted value is 10911, and then the correct formula is calculated by the following formula: the formula is 1-(|correct value-predicted value|/correct value), and the result is 1-(|10537- 10911|/10537)=96.45%; according to this side By analogy calculation, the correct rate of the test data (TDTRS) in the eight training stages can be obtained, and then the average correct rate is calculated. In this embodiment, the average correct rate of the neural network model 1 is 93.23%. The average correct rate corresponding to all 10 neural network models is listed below, as shown in Table 11.

表十一所示如下: Table 11 shows the following:

其中,訓練階段S401中之步驟S4012保留複數個預測正確率高的類神經網路係為:請求流量預測子系統將隨機產生之r個類神經網路模型的正確率與正確率門檻值w threshold 進行比對,排除低於此門檻值的類神經網路模型(即正確率過低的模型),餘下g個類神經網路模型;若無任何類神經網路模型之正確率高於門檻值時,將回到前一個S4011步驟,再重新設定門檻值以重新訓練隨機類神經網路群。在本實施例中,請求流量預測子系統將分析每個類神經網路模型的平均正確率,並將低於正確率門檻值w threshold (即本實施例所設定的94.5%)過濾掉,請參考表十一,其中類神經網路模型1、類神經網路模型3、類神經網路模型4、類神經網路模型6、類神經網路模型9、類神經網路模型10等6個將被過濾掉,剩下其餘4個類神經網路模型(即g值為4)及其分別之權重值留待實施階段使用。 Wherein, in step S401, the training phase of a plurality of correctly predicted retention S4012 high-based neural network as: traffic prediction subsystem requests generating the random number r accuracy of the neural network model with the correct rate threshold w threshold Perform an alignment to exclude a neural network model below this threshold (ie, a model with a low correct rate), and leave the remaining g neural network models; if there is no neural network model, the correct rate is higher than the threshold. When you return to the previous S4011 step, reset the threshold to retrain the random neural network group. In the present embodiment, the requesting subsystem will analyze the average traffic prediction accuracy of each neural network model, and the accuracy is lower than the threshold w threshold (i.e., 94.5% in Example of the present embodiment set) was filtered off, please Refer to Table 11 for six types: neural network model 1, neural network model 3, neural network model 4, neural network model 6, neural network model 9, neural network model 10, etc. It will be filtered out, leaving the remaining 4 neural network models (ie g value 4) and their respective weight values to be used in the implementation phase.

在前述請求流量預測方法中,實施階段S402主要亦可包含兩個步驟:步驟S4021輸入即時資料至訓練階段 中所保留之複數個預測正確率高的類神經網路、步驟S4022將複數個類神經網路產生之預測值進行加權平均得到最後的預測值。 In the foregoing request flow prediction method, the implementation stage S402 may further comprise two steps: inputting the real-time data to the training stage in step S4021 The plurality of neural network networks with high prediction accuracy are reserved in step S4022, and the predicted values generated by the plurality of neural networks are weighted and averaged to obtain the final predicted value.

其中,實施階段S402中,步驟S4021輸入即時資料至訓練階段中所保留之複數個預測正確率高的類神經網路步驟為:請求流量預測子系統取得即時的憑證請求查詢紀錄,用以輸入至訓練階段所保留的g個類神經網路模型以進行預測計算。請參考圖6所示,例如,憑證C1在2014/07/28該日期的請求流量集合為={,,...,}={1,2,...,82},將其作為隨機類神經網路群的輸入資料,進行步驟S601輸入即時請求流量集合,將其分別輸入至在訓練階段所剩下的4個類神經網路模型(類神經網路模型2、類神經網路模型5、類神經網路模型7、類神經網路模型8),以分別得出目標2014/07/29日期憑證C1請求流量預測值。 In the implementation stage S402, the step S4021 inputs the instant data to the plurality of neural network steps with high prediction accuracy rate retained in the training phase: requesting the traffic prediction subsystem to obtain an instant credential request query record for inputting to The g -like neural network models retained during the training phase are used for predictive calculations. Please refer to FIG. 6 , for example, the request flow set of the document C 1 on the date of 2014/07/28 is ={ , ,..., }={1,2,...,82}, as the input data of the random neural network group, input the instant request traffic set in step S601, and input them to the remaining 4 in the training phase respectively. Neural network model (class neural network model 2, neural network model 5, neural network model 7, neural network model 8) to obtain the target 2014/07/29 date certificate C 1 request Traffic forecast value.

其中,實施階段S402中,步驟S4022將複數個類神經網路產生之預測值進行加權平均得到最後的預測值之步驟為:由該g個類神經網路模型所產生出來之預測值,運用訓練階段時所得到之正確率作為權重,進行加權平均,以得到最終的請求流量預測值。請求流量預測子系統經過將資料輸入每個餘下的類神經網路模型(即類神經網路模型2、類神經網路模型5、類神經網路模型7、類神經網路模型8,如表十所示)的步驟S601後,可見圖6中,由類神經網路模型2、類神經網路模型5、類神經網路模型7、類神經網路模型8得出之憑證C1請求流量預測值分別為12716、12582、12565、12401,亦如下列表十二所示;最後,進行步驟S602,依每個類神經網路模型的權重對各預測值進行加權平均(類神經網路 模型2為94.90%、類神經網路模型5為94.61%、類神經網路模型7為94.93%、類神經網路模型8為95.21%)以得到最終的憑證C1之請求流量預測值12566。 In the implementation stage S402, the step S4022 performs a weighted average of the predicted values generated by the plurality of neural networks to obtain the final predicted value: the predicted values generated by the g neural network models are used for training. The correct rate obtained at the stage is used as a weight, and a weighted average is performed to obtain a final predicted flow rate. The request traffic prediction subsystem inputs the data into each of the remaining neural network models (ie, neural network model 2, neural network model 5, neural network model 7, neural network model 8, such as step 10 shown) in S601, after, visible in FIG. 6, 7, the neural network model is derived by the neural network model 2, 5 neural network models, neural network models C 1 certificate request traffic 8 The predicted values are 12716, 12582, 12565, and 12401, respectively, as shown in the following list 12. Finally, step S602 is performed to perform weighted averaging on the predicted values according to the weight of each type of neural network model (the neural network model 2 It is 94.90%, the neural network model 5 is 94.61%, the neural network model 7 is 94.93%, and the neural network model 8 is 95.21%) to obtain the final flow rate predicted value 12566 of the certificate C1.

表十二所示如下: Table 12 shows the following:

而本發明的預測請求流量之憑證預簽方法流程中,包含有前述的回覆簽章子系統進行的憑證狀態預簽章方法,其方法之步驟流程圖如圖7所示,主要將包含四個步驟,分別為:步驟S701接收待預簽章之憑證資訊、步驟S702偵測離峰時段、步驟S703對憑證狀態產製簽章值、步驟S704儲存預簽章憑證狀態;此憑證狀態預簽章方法可於離峰時間進行憑證狀態產製,以平衡負載。 The flow of the voucher pre-signing method for predicting request traffic of the present invention includes the voucher status pre-signature method performed by the foregoing reply signature subsystem, and the flow chart of the method is shown in FIG. 7 and mainly includes four The steps are: step S701 receives the voucher information to be pre-signed, step S702 detects the peak time period, step S703 records the voucher status production signature, and step S704 stores the pre-signed voucher status; the voucher status pre-signature The method can perform voucher state production at the off-peak time to balance the load.

其中,該步驟S701接收待預簽章之憑證資訊的步驟為:回覆簽章子系統接收憑證資訊和該憑證狀態請求流量預測值,以本實施例中的2014/07/29日期為例,請求流量預測子系統通過請求流量預測方法預測得出憑證C1狀態的請求流量預測值為12566,回覆簽章子系統接收此值為12566之請求流量預測值。 The step S701 receives the voucher information of the pre-signature is: the reply signature subsystem receives the voucher information and the voucher status request traffic prediction value, and takes the 2014/07/29 date in the embodiment as an example, requesting traffic prediction subsystem certificate C 1 stars state prediction by traffic prediction traffic prediction method is 12566 request, reply signature subsystem receives this request 12566 is the predicted value of the flow rate.

其中,該步驟S702偵測離峰時段之步驟為:回覆簽章子系統可向憑證資料庫取得歷史之憑證被請求查詢紀錄,以統計和分析離峰時段;以本實施例中2014/07/01~2014/07/28期間之憑證被請求查詢紀錄中,離峰時段為凌晨0時至6時。 The step S702 detects the peak time period: the reply signature subsystem can obtain the history certificate from the voucher database and request the query record to count and analyze the off-peak period; in this embodiment, 2014/07/ The voucher for the period 01~2014/07/28 was requested to be inquired for the record, and the peak period was from 0:00 am to 6:00 pm.

其中,該步驟S703對憑證狀態產製簽章值之步驟為:回覆簽章子系統依請求流量預測值對特定憑證狀態進行預簽章,產生預簽章憑證狀態之資料;在本實施例中,因被預測之憑證C1狀態的請求流量預測值為12566,故將由回覆簽章子系統對憑證C1狀態進行預簽章,以產生12566筆預簽章憑證狀態;本預簽章步驟端看前述步驟S702是否有執行,若步驟S702有執行並得出離峰時段,回覆簽章子系統可於離峰時間進行憑證狀態產製,以進行負載平衡。 The step S703 for producing a signature value for the voucher state is: the reply signature subsystem pre-signs the specific voucher status according to the requested traffic prediction value, and generates data of the pre-signature voucher status; in this embodiment , due to a predicted state of the document C is 12566 traffic prediction request, it will respond to the C state certificate signature subsystem 1 pre signatures, to produce a pre-signed certificate 12566 pen status; end of this pre-step signature Looking at whether the foregoing step S702 is performed, if the step S702 is executed and the off-peak period is obtained, the reply signature subsystem can perform the voucher state production at the off-peak time for load balancing.

其中,該步驟S704儲存預簽章憑證狀態之步驟為:在本實施例中,回覆簽章子系統將把12566筆預簽章憑證狀態之資料儲存至憑證資料庫,以供客戶端設備查詢及使用;且在客戶端設備查詢並取得預簽章憑證狀態之後,憑證資料庫將銷毀被取用之預簽章憑證狀態,即當被客戶端設備取走1筆後,憑證資料庫將剩餘12565筆預簽章憑證狀態,直至該預簽章憑證狀態被取完,憑證資料庫再無剩餘之預簽章憑證狀態。 The step of storing the status of the pre-signature voucher in step S704 is: in this embodiment, the reply signature subsystem will store the data of the 12566 pre-signature voucher status to the voucher database for the client device to query and After the client device queries and obtains the status of the pre-signature voucher, the voucher database will destroy the status of the pre-signed voucher that is taken, that is, when the client device takes one pen, the voucher database will have 12565 remaining. The pre-signature voucher status is completed until the pre-signature voucher status is completed, and the voucher database has no remaining pre-signed voucher status.

至此,本發明的預測請求流量之憑證預簽方法流程已結合實施例、圖式以及列表完畢。而該些詳細說明乃針對本發明之最佳實施例進行具體說明,惟該些實施例並非用以限制本發明之專利範圍,凡是未脫離本發明技藝精神所為之等效實施或變更,均應被包含於本案之專利範圍中。 So far, the flow of the voucher pre-signing method for predicting request traffic of the present invention has been completed in combination with the embodiments, the drawings, and the list. The detailed description of the present invention is intended to be illustrative of the preferred embodiments of the present invention. It is included in the patent scope of this case.

綜上所述,本發明於技術思想上確屬創新,充分符合新穎性及進步性等法定發明專利要件,爰依法提出專利申請,懇請 貴局核准本件發明專利申請案以勵發明,至感德便。 In summary, the present invention is truly innovative in terms of technical ideas, fully complies with the statutory invention patent requirements such as novelty and progressiveness, and submits a patent application according to law, and invites you to approve the invention patent application to encourage invention, to the sense Will.

Claims (1)

一種請求流量預測方法,包含下列步驟:一請求流量預測子系統自一憑證資料庫中取得複數憑證被請求之紀錄;該請求流量預測子系統係通過設定隨機類神經網路群演算法之相關參數值,分別依據各該憑證隨機建立複數個類神經網路以進行預測各該憑證的被請求流量;該請求流量預測子系統依據各該憑證被請求之紀錄訓練各該類神經網路;該請求流量預測子系統依據各該類神經網路的預測準確度是否通過一正確率門檻值以決定是否保留各該類神經網路;以及該請求流量預測子系統將保留下的各該類神經網路各自產生之預測值進行權重平均最後產生一請求流量預測值。 A method for requesting traffic prediction includes the following steps: a request traffic prediction subsystem obtains a record of a plurality of voucher requests from a voucher database; and the request traffic prediction subsystem sets a parameter related to a stochastic neural network group algorithm a value, respectively, randomly establishing a plurality of neural networks based on each of the credentials to predict the requested traffic of each of the credentials; the request traffic prediction subsystem trains each of the neural networks according to the requested records of the credentials; the request The traffic prediction subsystem determines whether to retain each of the neural networks according to whether the prediction accuracy of each of the neural networks passes a correct rate threshold; and the neural network that the request traffic prediction subsystem will retain The respective generated predicted values are weighted averaged to finally generate a requested traffic predicted value.
TW106109858A 2016-01-29 2016-01-29 Request traffic prediction method TWI646808B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106109858A TWI646808B (en) 2016-01-29 2016-01-29 Request traffic prediction method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106109858A TWI646808B (en) 2016-01-29 2016-01-29 Request traffic prediction method

Publications (2)

Publication Number Publication Date
TW201728134A TW201728134A (en) 2017-08-01
TWI646808B true TWI646808B (en) 2019-01-01

Family

ID=60186486

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106109858A TWI646808B (en) 2016-01-29 2016-01-29 Request traffic prediction method

Country Status (1)

Country Link
TW (1) TWI646808B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075352A (en) * 2010-12-17 2011-05-25 北京邮电大学 Method and device for predicting network user behavior
US7966487B2 (en) * 2004-01-09 2011-06-21 Corestreet, Ltd. Communication-efficient real time credentials for OCSP and distributed OCSP
CN102567781A (en) * 2011-12-20 2012-07-11 西北师范大学 Network behavior prediction method based on neural network
CN102592171A (en) * 2011-12-30 2012-07-18 南京邮电大学 Method and device for predicting cognitive network performance based on BP (Back Propagation) neural network
TWI474702B (en) * 2010-11-09 2015-02-21
TW201511515A (en) * 2013-09-06 2015-03-16 Chunghwa Telecom Co Ltd Method of dynamically adjusting cloud certificate status verification

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7966487B2 (en) * 2004-01-09 2011-06-21 Corestreet, Ltd. Communication-efficient real time credentials for OCSP and distributed OCSP
TWI474702B (en) * 2010-11-09 2015-02-21
CN102075352A (en) * 2010-12-17 2011-05-25 北京邮电大学 Method and device for predicting network user behavior
CN102567781A (en) * 2011-12-20 2012-07-11 西北师范大学 Network behavior prediction method based on neural network
CN102592171A (en) * 2011-12-30 2012-07-18 南京邮电大学 Method and device for predicting cognitive network performance based on BP (Back Propagation) neural network
TW201511515A (en) * 2013-09-06 2015-03-16 Chunghwa Telecom Co Ltd Method of dynamically adjusting cloud certificate status verification

Also Published As

Publication number Publication date
TW201728134A (en) 2017-08-01

Similar Documents

Publication Publication Date Title
Wang et al. Sustainable transportation network design with stochastic demands and chance constraints
Mitzenmacher Analyzing distributed join-idle-queue: A fluid limit approach
CN104601586B (en) The outsourcing statistical method that a kind of disclosure can verify that
CN113421165A (en) Method and system for evaluating and managing green financial products
CN111784204A (en) High-quality user mining method and system based on user power consumption behavior portrait
Alswailim et al. A reputation system to evaluate participants for participatory sensing
CN109508807A (en) Lottery user liveness prediction technique, system and terminal device, storage medium
Kim et al. Short-term electric load forecasting using data mining technique
Adepeju et al. Anchored k-medoids: a novel adaptation of k-medoids further refined to measure long-term instability in the exposure to crime
CN114462683A (en) Cloud edge collaborative multi-residential area load prediction method based on federal learning
TWI591991B (en) System and method for pre-signing vouchers for forecasting requests for traffic
CN103106329A (en) Training sample grouping construction method used for support vector regression (SVR) short-term load forecasting
CN111325255B (en) Specific crowd delineating method and device, electronic equipment and storage medium
Fu et al. Applying DEA–BPN to enhance the explanatory power of performance measurement
TWI646808B (en) Request traffic prediction method
TWI628935B (en) Request traffic grouping method
TWI644542B (en) Pre-signature method
CN116170162A (en) Selective consensus method, computer storage medium, and terminal device
CN114693112A (en) Riding method and device based on block chain, computer equipment and storage medium
Deshani et al. Improved neural network prediction performances of electricity demand: modifying inputs through clustering
CN106991616A (en) Network edge Combo discovering method based on the model of side zero
Caughey et al. Polarization and Partisan divergence in the American public, 1946-2012
Smith Measuring the relative outputs of computational researchers in higher education
JP2020047079A (en) Learning program, learning method and learning device
CN107832933A (en) A kind of index simplifying method of power distribution network input-output evaluation system