JP2018509709A5 - - Google Patents

Download PDF

Info

Publication number
JP2018509709A5
JP2018509709A5 JP2017546680A JP2017546680A JP2018509709A5 JP 2018509709 A5 JP2018509709 A5 JP 2018509709A5 JP 2017546680 A JP2017546680 A JP 2017546680A JP 2017546680 A JP2017546680 A JP 2017546680A JP 2018509709 A5 JP2018509709 A5 JP 2018509709A5
Authority
JP
Japan
Prior art keywords
query
execution
difference
time
time data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2017546680A
Other languages
Japanese (ja)
Other versions
JP7064333B2 (en
JP2018509709A (en
Filing date
Publication date
Priority claimed from US14/665,171 external-priority patent/US10740358B2/en
Application filed filed Critical
Priority claimed from PCT/US2016/021642 external-priority patent/WO2016153790A1/en
Publication of JP2018509709A publication Critical patent/JP2018509709A/en
Publication of JP2018509709A5 publication Critical patent/JP2018509709A5/ja
Priority to JP2021020802A priority Critical patent/JP7142116B2/en
Application granted granted Critical
Publication of JP7064333B2 publication Critical patent/JP7064333B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Claims (11)

コンピュータシステムに格納されているデータの1つ以上の更新をコンピュータシステムにおいて受信するステップと、
受信された前記更新に基づいて、コンピュータシステム内の1つ以上の多時間データ項目を更新するステップと、
第1クエリが前記更新された多時間データ項目に依存するという判断に基づいて、前記コンピュータシステム内で前記第1クエリを特定するステップと、
現在の時間に対応する多時間データを用いて、前記第1クエリの第1実行を行うステップと、
前記第1クエリの過去実行に対応する過去時間に対応する多時間データを用いて、前記第1クエリの第2実行を行うステップと、
前記第1クエリの前記第1実行の結果と前記第1クエリの前記第2実行の結果との差を決定するステップと、
前記差を所定の閾値と比較するステップと、
前記差が前記所定の閾値よりも大きいと判定した場合に、前記第1クエリに関連する第1データオブジェクトに対して第1変換処理を呼び出すステップとを含む、方法。
Receiving at the computer system one or more updates of data stored in the computer system;
Updating one or more multi-time data items in the computer system based on the received update;
Identifying the first query in the computer system based on a determination that the first query is dependent on the updated multi-time data item;
Performing a first execution of the first query using multi-time data corresponding to a current time;
Performing second execution of the first query using multi-time data corresponding to past time corresponding to past execution of the first query;
Determining a difference between a result of the first execution of the first query and a result of the second execution of the first query;
Comparing the difference with a predetermined threshold;
Invoking a first transformation process on a first data object associated with the first query when it is determined that the difference is greater than the predetermined threshold.
前記第1変換処理は、HADOOPデータ処理クラスタの計算ノード内で実行されるデータ変換ループアプリケーションによって実行される、請求項1に記載の方法。   The method of claim 1, wherein the first transformation process is performed by a data transformation loop application that is executed within a compute node of a HADOOP data processing cluster. 前記第1変換処理は、機械学習プロセス、生データ処理の分類、サポートベクトルマシン、ナイーブベイズ分類器、神経ネットワーク、クラスタリング、関連ルール、決定木、単変量周期線形傾向、多変量状態推定技術、認知コンピューティング、ベイジアン信念ネットワーク、逆問題に対する解の最小二乗最適化または回帰、影響図、デンプスター・シェイファー理論、決定木、残存有効寿命の予後、スクリプト、計画、予定、BPELワークフロー、およびBPMNビジネスプロセスのうち、1つ以上を含む、請求項2に記載の方法。   The first transformation processing includes machine learning process, raw data processing classification, support vector machine, naive Bayes classifier, neural network, clustering, related rules, decision tree, univariate periodic linear trend, multivariate state estimation technology, cognition Computing, Bayesian belief networks, least squares optimization or regression of solutions to inverse problems, impact diagrams, Dempster-Shafer theory, decision trees, remaining useful life prognosis, scripts, plans, schedules, BPEL workflows, and BPMN business processes The method of claim 2, comprising one or more of: 前記第1データオブジェクトに対する前記第1変換処理の結果に対応する第2データオブジェクトを格納するステップと、
前記第2データオブジェクトと、前記第1変換処理の過去の呼び出しによって生成され且つ前記第2データオブジェクトと同一タイプの異なるデータオブジェクトとの間の差を決定するステップと、
前記第2データオブジェクトと前記異なるデータオブジェクトとの間の前記差が第2所定の閾値よりも大きいという判定に基づいて、前記第2データオブジェクトに対して第2変換処理を呼び出すステップとを含む、請求項1に記載の方法。
Storing a second data object corresponding to a result of the first conversion process on the first data object;
Determining a difference between the second data object and a different data object of the same type as the second data object generated by a previous call of the first conversion process;
Calling a second transformation process on the second data object based on a determination that the difference between the second data object and the different data object is greater than a second predetermined threshold; The method of claim 1.
前記第1変換処理および第2変換処理は、連続データ変換ループアプリケーションの一部であり、
前記方法は、
前記コンピュータシステムに格納されている前記多時間データの1つ以上の追加更新を受信するステップと、
受信された前記追加更新に基づいて、一組の多時間データ項目を更新するステップと、
前記多時間データの前記追加更新を用いて、前記第1クエリの第3実行を行うステップと、
前記第1クエリの過去実行時間に対応する多時間データを用いて、前記第1クエリの第4実行を行うステップと、
前記第1クエリの前記第3実行の結果と前記第1クエリの前記第4実行の結果との間の差を決定するステップと、
前記差を前記所定の閾値と比較するステップと、
前記差が前記所定の閾値よりも大きいと判定した場合に、前記第1変換処理を再度呼び出すステップとをさらに含む、請求項4に記載の方法。
The first conversion process and the second conversion process are part of a continuous data conversion loop application;
The method
Receiving one or more additional updates of the multi-time data stored in the computer system;
Updating a set of multi-time data items based on the received additional updates;
Performing a third execution of the first query using the additional update of the multi-time data;
Performing a fourth execution of the first query using multi-time data corresponding to a past execution time of the first query;
Determining a difference between a result of the third execution of the first query and a result of the fourth execution of the first query;
Comparing the difference to the predetermined threshold;
The method according to claim 4, further comprising a step of re-invoking the first conversion process when it is determined that the difference is larger than the predetermined threshold value.
前記更新された1つ以上の多時間データ項目は、各データ項目のトランザクション時間および有効時間を含む双時間データ項目である、請求項1〜5のいずれかに記載の方法。 The updated one or more multi-time data item has been is a bi-time data item including the transaction time and valid time for each data item, the method according to any one of claims 1-5. 前記第1クエリを特定するステップは、前記コンピュータシステム内のフィルタテーブルにアクセスすることを含み、
前記フィルタテーブルは、異なる変換処理にそれぞれ対応する複数のクエリを含む、請求項1〜6のいずれかに記載の方法。
Identifying the first query includes accessing a filter table in the computer system;
The filter table comprises a plurality of queries that correspond to the different conversion method according to any one of claims 1 to 6 in.
前記第1クエリを特定するステップと、前記第1クエリの第1実行を行うステップと、前記第1クエリの第2実行を行うステップと、前記第1クエリの前記第1実行と前記第1クエリの第2実行との間の差を前記所定の閾値と比較するステップとは、前記1つ以上の多時間データ項目の更新として、第1トランザクションの外部で前記第1トランザクションと非同期的に実行され、
前記第1データオブジェクトに対する前記第1変換処理の前記呼び出しは、前記第1トランザクションの外部で前記第1トランザクションと非同期的に実行される、請求項1〜7のいずれかに記載の方法。
Identifying the first query, performing a first execution of the first query, performing a second execution of the first query, the first execution of the first query, and the first query. Comparing the difference between the second execution of the first and second executions with the predetermined threshold is performed asynchronously with the first transaction outside the first transaction as an update of the one or more multi-time data items. ,
Wherein for the first data object the call to the first conversion process, the first transaction is outside executed the first transaction and asynchronously of method according to any one of claims 1-7.
1つ以上のプロセッサを含む処理ユニットと、
前記処理ユニットに連結され、前記処理ユニットによって読取可能であり、一連の命令セットを格納するメモリとを備え、前記命令は、前記処理ユニットによって実行される場合、前記処理ユニットに、以下のステップ、すなわち、
コンピュータシシステムに格納されているデータの1つ以上の更新を受信するステップと、
受信された前記更新に基づいて、コンピュータシステム内の1つ以上の多時間データ項目を更新するステップと、
第1クエリが前記更新された多時間データ項目に依存するという判断に基づいて、前記コンピュータシステム内で前記第1クエリを特定するステップと、
現在の時間に対応する多時間データを用いて、前記第1クエリの第1実行を行うステップと、
前記第1クエリの過去実行に対応する過去時間に対応する多時間データを用いて、前記第1クエリの第2実行を行うステップと、
前記第1クエリの前記第1実行の結果と前記第1クエリの前記第2実行の結果との差を決定するステップと、
前記差を所定の閾値と比較するステップと、
前記差が前記所定の閾値よりも大きいと判定した場合に、前記第1クエリに関連する第1データオブジェクトに対して第1変換処理を呼び出すステップとを実行させる、システム。
A processing unit including one or more processors;
A memory coupled to the processing unit, readable by the processing unit, and storing a series of instruction sets, wherein when the instructions are executed by the processing unit, the processing unit includes the following steps: That is,
Receiving one or more updates of data stored in the computer system;
Updating one or more multi-time data items in the computer system based on the received update;
Identifying the first query in the computer system based on a determination that the first query is dependent on the updated multi-time data item;
Performing a first execution of the first query using multi-time data corresponding to a current time;
Performing second execution of the first query using multi-time data corresponding to past time corresponding to past execution of the first query;
Determining a difference between a result of the first execution of the first query and a result of the second execution of the first query;
Comparing the difference with a predetermined threshold;
And a step of calling a first conversion process on a first data object related to the first query when it is determined that the difference is greater than the predetermined threshold.
請求項1〜8のいずれかに記載の方法をコンピュータに実行させるためのプログラム。A program for causing a computer to execute the method according to claim 1. 請求項10に記載のプログラムを格納したメモリと、A memory storing the program according to claim 10;
前記プログラムを実行するためのプロセッサとを備える、システム。And a processor for executing the program.
JP2017546680A 2015-03-23 2016-03-10 Knowledge-intensive data processing system Active JP7064333B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021020802A JP7142116B2 (en) 2015-03-23 2021-02-12 Knowledge-intensive data processing system

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/665,171 US10740358B2 (en) 2013-04-11 2015-03-23 Knowledge-intensive data processing system
US14/665,171 2015-03-23
PCT/US2016/021642 WO2016153790A1 (en) 2015-03-23 2016-03-10 Knowledge-intensive data processing system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2021020802A Division JP7142116B2 (en) 2015-03-23 2021-02-12 Knowledge-intensive data processing system

Publications (3)

Publication Number Publication Date
JP2018509709A JP2018509709A (en) 2018-04-05
JP2018509709A5 true JP2018509709A5 (en) 2019-04-11
JP7064333B2 JP7064333B2 (en) 2022-05-10

Family

ID=55590161

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2017546680A Active JP7064333B2 (en) 2015-03-23 2016-03-10 Knowledge-intensive data processing system
JP2021020802A Active JP7142116B2 (en) 2015-03-23 2021-02-12 Knowledge-intensive data processing system

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2021020802A Active JP7142116B2 (en) 2015-03-23 2021-02-12 Knowledge-intensive data processing system

Country Status (4)

Country Link
EP (1) EP3274869A1 (en)
JP (2) JP7064333B2 (en)
CN (1) CN107430613B (en)
WO (1) WO2016153790A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10740358B2 (en) 2013-04-11 2020-08-11 Oracle International Corporation Knowledge-intensive data processing system
US9330119B2 (en) 2013-04-11 2016-05-03 Oracle International Corporation Knowledge intensive data management system for business process and case management
US11443206B2 (en) 2015-03-23 2022-09-13 Tibco Software Inc. Adaptive filtering and modeling via adaptive experimental designs to identify emerging data patterns from large volume, high dimensional, high velocity streaming data
US10534643B2 (en) 2016-05-09 2020-01-14 Oracle International Corporation Correlation of thread intensity and heap usage to identify heap-hoarding stack traces
CN108319437B (en) * 2018-02-28 2019-01-11 上海熙香艺享电子商务有限公司 Content big data concentration analysis platform
CN108805818B (en) * 2018-02-28 2020-07-10 上海兴容信息技术有限公司 Content big data density degree analysis method
TWI669668B (en) * 2018-03-21 2019-08-21 兆豐國際商業銀行股份有限公司 Data management device and data management method
CN108595644A (en) * 2018-04-26 2018-09-28 宁波银行股份有限公司 A kind of big data platform operation management system
CN108804556B (en) * 2018-05-22 2020-10-20 上海交通大学 Distributed processing framework system based on time travel and temporal aggregation query
CN109104378B (en) * 2018-08-17 2019-08-20 四川新网银行股份有限公司 The pre- recovery method of intelligent token based on time series forecasting
CN109242550B (en) * 2018-08-21 2021-09-21 首钢京唐钢铁联合有限责任公司 Steel process cost prediction system
US11481379B2 (en) 2018-11-01 2022-10-25 Hewlett-Packard Development Company, L.P. Metadata variance analytics
WO2020117669A1 (en) * 2018-12-03 2020-06-11 DSi Digital, LLC Data interaction platforms utilizing dynamic relational awareness
US11182362B2 (en) 2019-01-16 2021-11-23 Kabushiki Kaisha Toshiba Calculating device, data base system, calculation system, calculation method, and storage medium
CN110008262B (en) * 2019-02-02 2023-06-06 创新先进技术有限公司 Data export method and device
US20200310449A1 (en) * 2019-03-26 2020-10-01 GM Global Technology Operations LLC Reasoning system for sensemaking in autonomous driving
US11544566B2 (en) 2019-06-03 2023-01-03 International Business Machines Corporation Deep learning model insights using provenance data
JP7372530B2 (en) 2019-10-07 2023-11-01 横浜ゴム株式会社 Kneading abnormality degree learning device, learned model generation method and program
CN110750384A (en) * 2019-10-15 2020-02-04 浙江众鑫空间科技有限公司 Big data management system
US11237847B1 (en) 2019-12-19 2022-02-01 Wells Fargo Bank, N.A. Automated standards-based computing system reconfiguration
US11502905B1 (en) 2019-12-19 2022-11-15 Wells Fargo Bank, N.A. Computing infrastructure standards assay
CN111506349A (en) * 2020-04-30 2020-08-07 中科院计算所西部高等技术研究院 Calculation board card with OODA (on-off-the-digital-analog) multiprocessor
CN112422234B (en) * 2020-11-06 2021-08-13 应急管理部通信信息中心 Data management service method for self-adaptive deep learning based on time perception
CN112990767B (en) * 2021-04-20 2021-08-20 上海领健信息技术有限公司 Vertical consumption medical SaaS production data calculation method, system, terminal and medium
CN116646061B (en) * 2023-04-28 2024-01-26 西安交通大学 Distributed CT imaging and intelligent diagnosis and treatment system and method

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2828609B2 (en) * 1994-09-22 1998-11-25 株式会社エイアンドティー Clinical laboratory analyzer
JP4405658B2 (en) * 2000-11-01 2010-01-27 住友林業株式会社 Housing management method
CN101231642A (en) * 2007-08-27 2008-07-30 中国测绘科学研究院 Space-time database administration method and system
US8156136B2 (en) * 2008-10-16 2012-04-10 The Curators Of The University Of Missouri Revising imagery search results based on user feedback
JP2011055355A (en) 2009-09-03 2011-03-17 Oki Electric Industry Co Ltd Wireless communication apparatus and program, and, wireless communication system
CN102411599A (en) * 2011-08-01 2012-04-11 中国民生银行股份有限公司 Method for processing abnormal behaviors in data base and monitoring server
US8965889B2 (en) * 2011-09-08 2015-02-24 Oracle International Corporation Bi-temporal user profiles for information brokering in collaboration systems
CN102651020B (en) * 2012-03-31 2014-01-15 中国科学院软件研究所 Method for storing and searching mass sensor data
CN102799621B (en) * 2012-06-25 2015-03-25 国家测绘局卫星测绘应用中心 Method for detecting change of vector time-space data and system of method
JP2014021585A (en) * 2012-07-13 2014-02-03 Sharp Corp Network system and information processing device
US8812489B2 (en) * 2012-10-08 2014-08-19 International Business Machines Corporation Swapping expected and candidate affinities in a query plan cache
US9734161B2 (en) * 2013-03-15 2017-08-15 The Florida International University Board Of Trustees Streaming representation of moving objects and shapes in a geographic information service
US9330119B2 (en) * 2013-04-11 2016-05-03 Oracle International Corporation Knowledge intensive data management system for business process and case management
US9299113B2 (en) * 2013-09-13 2016-03-29 Microsoft Technology Licensing, Llc Social media driven information interface
CN103779808A (en) * 2013-12-30 2014-05-07 国家电网公司 Power transmission line intelligent inspection system based on LiDAR
CN104408137B (en) * 2014-11-28 2018-11-13 武汉大学 A kind of network statistics map visualization data preparation method

Similar Documents

Publication Publication Date Title
JP2018509709A5 (en)
Assefi et al. Big data machine learning using apache spark MLlib
CN109416765B (en) Metadata driven machine learning for systems
Cheng et al. A hybrid evolutionary algorithm to solve the job shop scheduling problem
US20230036702A1 (en) Federated mixture models
JP2019535065A5 (en)
Jakobović et al. Evolving priority scheduling heuristics with genetic programming
US7707549B2 (en) Synchronicity in software development
CN110263979B (en) Method and device for predicting sample label based on reinforcement learning model
WO2019154108A1 (en) Method and apparatus for processing transaction data
CN108108233B (en) Cluster job scheduling method and system for task multi-copy execution
Dasgupta et al. A discrete inter-species cuckoo search for flowshop scheduling problems
US20150317594A1 (en) Actions for an information technology case
CN109076107A (en) It is customized based on detection and the automatic detection and optimization of user experience upgrading is provided
US20150234936A1 (en) Event propagation in graph data
Zięba Service-oriented medical system for supporting decisions with missing and imbalanced data
US11755951B2 (en) Machine learning with an intelligent continuous learning service in a big data environment
Weng et al. Dynamic routing strategies for JIT production in hybrid flow shops
US8214316B2 (en) Notification-based forward chaining
Liu et al. Scheduling optimization of task allocation in integrated manufacturing system based on task decomposition
Qazi et al. Cloud datacenter workload prediction using complex-valued neural networks
Asfoor et al. Computing fuzzy rough approximations in large scale information systems
Breunig et al. Building smarter cars with smarter factories: How AI will change the auto business
CN112214718A (en) Method for solving bounded knapsack problem based on improved dynamic programming algorithm
Shang et al. A parallel and efficient algorithm for learning to match