CN104679740B - Data handling system - Google Patents
Data handling system Download PDFInfo
- Publication number
- CN104679740B CN104679740B CN201310609945.9A CN201310609945A CN104679740B CN 104679740 B CN104679740 B CN 104679740B CN 201310609945 A CN201310609945 A CN 201310609945A CN 104679740 B CN104679740 B CN 104679740B
- Authority
- CN
- China
- Prior art keywords
- instruction
- client
- handling system
- browser
- data handling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The present invention proposes data handling system.Wherein, the system includes browser, for constructing data processing request based on user instruction and the data processing request being sent into client；Client, for each instruction that handles successively in each instruction set in each operation template in the data processing request received of being communicated via the data with least one destination host, and the results set file corresponding with the operation template is constructed so that the browser is read based on result；Destination host, for assisting the client to complete the processing to each instruction in the corresponding instruction set in each operation template.Data handling system disclosed in this invention has high scalability, flexibility, applicability and the fast search that can realize knowledge source.
Description
Technical field
The present invention relates to data handling system, at the data automatically analyzed based on instruction result
Reason system.
Background technology
At present, with computer technology and the increasingly extensive and business of continuous development and different field of network application
Species becomes increasingly abundant, based on automation（Or partial automation）The data handling system of pattern becomes more and more important.
In existing technical scheme, in order to realize the automatic operating of data handling system, generally use writes script
And the mode of configuring timing tasks is realized.However, there are the following problems for existing technical scheme：（1）Due to passing through script
Mode performs fixed operation using fixed instruction or instruction set or configuration regular time, therefore must in newly increased requirement
Script or the configurator of modification correlation must be write again, therefore there is relatively low flexibility；（2）Due to specific script usually only
Suitable for specific scene, therefore the function of script can not decompose or dynamic expansion, thus causes flexibility relatively low；（3）Script
Operation result or error information be frequently difficult to understand, thus fault location is less efficient；（4）In the mistake of operating data processing system
Cheng Zhong, operator usually need to obtain the knowledge in terms of some technologies or business, but due to different data sources（Knowledge source）Number
According to often having inconsistent form, so as to be difficult to realize uniform format and fast search.
Accordingly, there exist following demand：There is provided with high scalability, flexibility, applicability and knowledge can be realized
The data handling system automatically analyzed based on instruction result of the fast search in source.
The content of the invention
In order to solve the problems of above-mentioned prior art, the present invention is proposed with high scalability, spirit
Activity, applicability and can realize knowledge source fast search based on the data processing system that automatically analyzes of instruction result
System.
The purpose of the present invention is achieved through the following technical solutions：
A kind of data handling system, the data handling system include：
Browser, the browser are based on user instruction construction data processing request and transmit the data processing request
To client, wherein, the data processing request includes at least one operation template, and each operation template is by least one instruction
Collection is combined into, and each instruction set includes at least one instruction；
Client, the client via the data with least one destination host communicate successively processing receive described in
Each instruction in each instruction set in each operation template in data processing request, and based on result construction with
The corresponding results set file of the operation template reads for the browser, wherein, the results set file includes
The implementing result of each instruction at least one operation template；
Destination host, the destination host assist the client to complete to the corresponding instruction set in each operation template
The processing of each instruction in conjunction.
In scheme disclosed above, it is preferable that what at least one operation template pre-defined selected from user
Operation template set, and wherein, the different operation templates in the operation template set can be multiplexed identical instruction set
Close, and different instruction sets can be multiplexed identical instruction.
In scheme disclosed above, it is preferable that the browser periodically reads the result in an asynchronous manner
Set a file.
In scheme disclosed above, it is preferable that each instruction at least one operation template is held
After the completion of row, the client is pre-configured with based on the related instruction execution result in the results set file and user
Comparative run performs analysis operation.
In scheme disclosed above, it is preferable that the client is receiving the number from the browser
According to processing ask after respectively generation and each corresponding job instances at least one operation template, then in correlation
Security authentication operation after the completion of start correlation the progress of work to realize the data communication process with the destination host, and deposit
Store up the results set file.
In scheme disclosed above, it is preferable that the client performs the analysis operation as follows：（1）
Each instruction execution result in the results set file is divided into some subdomains；（2）Performed for each subdomain
Predetermined analytic function is to obtain the analysis result of Boolean form；（3）The analysis result for each subdomain is collected, and will be received
The analysis result of each subdomain of collection studies and judges expression formula to obtain total analysis result applied to predetermined；（4）Will be described total
Analysis result feeds back to the browser.
In scheme disclosed above, it is preferable that the predetermined analytic function uses following matching process：Canonical
Match somebody with somebody, matching, line number matching and function matching in full.
In scheme disclosed above, it is preferable that in data handling system disclosed in this invention, the browser
1 can receive the source file of the different content form of user's submission and send it to the client 2.
In scheme disclosed above, it is preferable that the source file that the client storage receives and described
Recorded corresponding to increasing in the corresponding traffic table of database, and pass through the browser prompts user configuration and the source document
The associated property value of part, the word that then source file and property value associated there are imported into the database
In allusion quotation model.
In scheme disclosed above, it is preferable that perform knowledge file query process as follows：（1）It is described clear
Device of looking at is based on user instruction construction knowledge query request and knowledge query request is sent into the client 2, wherein, institute
State knowledge query request bag and contain query type；（2）The client asks indicated query type according to the knowledge query
Inquire about the database and the record of acquisition is returned into the browser to be shown to user；（3）The browser is by user
The identifier of the record of selection sends the client to；（4）The client obtains and the identifier according to the identifier
The property value of the associated source file being stored in data model, and the property value and the record selected by user are entered
Row matching, is then sent to the browser to be shown to user in the form of predefined by matching result.
Data handling system disclosed in this invention has the following advantages that：（1）Due to different in operation template set
Operation template can be multiplexed identical instruction set, and different instruction sets can be multiplexed identical instruction, therefore with very
High scalability and flexibility；（2）Due to can be analyzed automatically according to configuration parameter the implementing result of instruction, therefore
Fault location is more accurate and more efficient；（3）Because user can configure the property value associated with source file (such as text
Part item title, field delimiter, field definition domain（The implication explanation of i.e. each field）Etc.), therefore different-format can be realized
Knowledge file quick search；（4）Due to different matching algorithm and logical expression can be supported, therefore can be to instruction
Implementing result carry out complicated, differentiation pre- setting analysis, so as to obtain more accurately analysis result.
Brief description of the drawings
With reference to accompanying drawing, technical characteristic of the invention and advantage will be more fully understood by those skilled in the art, wherein：
Fig. 1 is the signal of the data handling system according to an embodiment of the invention automatically analyzed based on instruction result
Property structure chart.
Embodiment
Fig. 1 is the signal of the data handling system according to an embodiment of the invention automatically analyzed based on instruction result
Property structure chart.As shown in figure 1, data handling system disclosed in this invention includes browser 1, client 2 and destination host
3.Wherein, the browser 1 is based on user instruction construction data processing request and the data processing request is sent into client
End 2, wherein, the data processing request includes at least one operation template, and each operation template is by least one instruction set
Composition, and each instruction set includes at least one instruction.The client 2 is via the number with least one destination host 3
Handled successively according to communication every in each instruction set in each operation template in the data processing request received
Individual instruction, and the results set file corresponding with the operation template is constructed so that the browser 1 is read based on result
Take, wherein, the results set file includes the implementing result of each instruction at least one operation template（It is optional
Ground, analysis result can also be included）.The destination host 3 assists the client 2 to complete to the correspondence in each operation template
Instruction set in each instruction processing.
Preferably, in data handling system disclosed in this invention, at least one operation template is selected from user
Pre-defined operation template set, and wherein, the different operation templates in the operation template set can be multiplexed phase
Same instruction set, and different instruction sets can be multiplexed identical instruction.
Preferably, in data handling system disclosed in this invention, the browser 1 is periodically read in an asynchronous manner
Take the results set file.
Preferably, it is each at least one operation template in data handling system disclosed in this invention
After the completion of instruction is performed, the client 2 is based on the related instruction execution result and use in the results set file
The comparative run that family is pre-configured with（Exemplarily, it can include matching process, match parameter and study and judge expression formula）Perform and divide
Analysis operation（Whether the result that i.e. decision instruction performs meets expection）.
Preferably, in data handling system disclosed in this invention, the client 2 is browsed from described receiving
Generation and each corresponding operation at least one operation template are real respectively after the data processing request of device 1
Example, then in the security authentication operation of correlation（Such as user name, password etc. security factor are inputted to be authenticated）After the completion of
Start the related progress of work to realize the data communication process with the destination host 3, and store the results set file.
Preferably, in data handling system disclosed in this invention, the client 2 performs described point as follows
Analysis operation：（1）Each instruction execution result in the results set file is divided into some subdomains（Exemplarily, can be with
Based on geometry（Such as go, row, rectangle etc.）Part of speech can also be based on（Such as adjective, verb etc.）Carry out the division）；
（2）Predetermined analytic function is performed for each subdomain（Such as based on text matches be non-analysis process, it can be
Regular expression form or line number limitation whether result of determination）To obtain the analysis result of Boolean form；（3）
The analysis result for each subdomain is collected, and by the analysis result of collected each subdomain（Boolean）Applied to predetermined
Study and judge expression formula（Such as in the form of logical expression）To obtain total analysis result；（4）Total analysis result is anti-
Feed the browser 1.Therefore described study and judge the programming framework that " decomposition-analysis-integration " is realized on process nature.
In data handling system disclosed in this invention, the division for referring to textview field is decomposed, analysis refers to specifically study and judge function, whole
Conjunction refers to that Boolean expression parses.
Exemplarily, in data handling system disclosed in this invention, the predetermined analytic function uses following
Method of completing the square：Canonical matching, in full matching, line number matching and function matching.
Preferably, in data handling system disclosed in this invention, the client 2 stores total analysis result
And total analysis result is shown to user by the browser 1.
Preferably, in data handling system disclosed in this invention, the client 2 records itself and the destination host
The content of all data communication between 3, so that user enters edlin, audit, form export and day by the browser 1
Will such as checks at the operation.
Preferably, in data handling system disclosed in this invention, the browser 1 can receive user and submit not
With the source file of content format（Such as technology or professional knowledge file）And send it to the client 2.
Preferably, in data handling system disclosed in this invention, the client 2 stores the source document received
Part simultaneously increases corresponding record in the corresponding traffic table of the database, and prompts user to match somebody with somebody by the browser 1
Put the property value associated with the source file (such as file item title, field delimiter, field definition domain（I.e. each field
Implication explanation）Etc.), then the source file and property value associated there are imported（Such as pass through side line by line
Formula）Into the dictionary model in the database.Exemplarily, said process can be realized as follows：By on source file
The client is deposited in after biography, the attribute of the source file of correlation is then defined in user（Such as separator, field description, industry
Business table name）Afterwards, imported, data model is now generated in database.
Preferably, in data handling system disclosed in this invention, knowledge file query process is performed as follows：
（1）The browser 1 is based on user instruction construction knowledge query request and knowledge query request is sent into the client
End 2, wherein, the knowledge query request bag contains query type（Exemplarily, the query type includes fuzzy query（Full table
Inquiry）And accurate inquiry（Specified services table name））；（2）The client 2 is according to knowledge query request indicated
Query type inquires about the database and the record of acquisition is returned into the browser 1 to be shown to user；（3）It is described to browse
The record that device 1 selects user（Such as user selects record interested by clicking operation）Identifier send the visitor to
Family end 2；（4）The client 2 obtains associated with the identifier be stored in data model according to the identifier
The property value of source file（Such as file item title, field delimiter, field definition domain（The implication explanation of i.e. each field）Deng
Deng）, and the property value is matched with the record selected by user, then matching result is transmitted in the form of predefined
To the browser to be shown to user.Exemplarily, above-mentioned knowledge file querying method can be implemented as follows：
（1）Relational data is subjected to typing in a manner of defining symbol file；（2）Define domain name；（3）Row records series are turned into character
String；（4）Full-text search is carried out in character string to the keyword of user's input；（5）The character string parsing searched out is remembered for row
Record and present.Therefore.This method can be highly suitable for the search of the uncertain relational data table of domain quantity.
Therefore in data handling system disclosed in this invention, task scheduling part uses hierarchical Design, progressively
Decoupling, the design philosophy of " task " unrelated with goal systems is finally taken out, the Main Basiss of abstraction hierarchy division are mesh
Mark order, atomicity and the correlation of operation.
Data handling system disclosed in this invention includes：（1）Atomic operation：Instruct；（2）Related set in order：
That is instruction set；（3）Unordered related set：That is operation template.In other words, an operation template is a single task
（Designated herein is independent, refers between task it is unordered unrelated）.Therefore, data handling system disclosed in this invention is actual
On realize a kind of task scheduling system towards general job, thus there is extensive universality.
Therefore data handling system disclosed in this invention has following advantages：（1）Due in operation template set
Different operation templates can be multiplexed identical instruction set, and different instruction sets can be multiplexed identical instruction,
Therefore there is very high scalability and flexibility；（2）Due to can enter automatically according to configuration parameter to the implementing result of instruction
Row analysis, therefore fault location is more accurate and more efficient；（3）Because user can configure the attribute associated with source file
It is worth (such as file item title, field delimiter, field definition domain（The implication explanation of i.e. each field）Etc.), therefore can realize
The quick search of the knowledge file of different-format；（4）Due to different matching algorithm and logical expression can be supported, therefore can
To carry out complicated, differentiation pre- setting analysis to the implementing result of instruction, so as to obtain more accurately analysis result.
Although the present invention is described by above-mentioned preferred embodiment, its way of realization is not limited to
Above-mentioned embodiment.It should be realized that：In the case where not departing from spirit and scope of the present invention, those skilled in the art can be with
Different change and modifications is made to the present invention.
Claims (10)
1. a kind of data handling system, the data handling system includes：
Browser, the browser are based on user instruction construction data processing request and the data processing request are sent into visitor
Family end, wherein, the data processing request includes at least one operation template, and each operation template is by least one instruction set
Composition, and each instruction set includes at least one instruction；
Client, the client communicate the data for handling receive successively via the data with least one destination host
Processing request in each operation template in each instruction set in each instruction, and based on result construction with it is described
The corresponding results set file of operation template reads for the browser, wherein, the results set file includes described
The implementing result of each instruction at least one operation template；
Destination host, the destination host assist the client to complete in the corresponding instruction set in each operation template
Each instruction processing.
2. data handling system according to claim 1, it is characterised in that at least one operation template is selected from use
The pre-defined operation template set in family, and wherein, the different operation templates in the operation template set can be multiplexed
Identical instruction set, and different instruction sets can be multiplexed identical instruction.
3. data handling system according to claim 2, it is characterised in that the browser is periodically in an asynchronous manner
Read the results set file.
4. data handling system according to claim 3, it is characterised in that every at least one operation template
The client is based on the related instruction execution result and use in the results set file after the completion of individual instruction is performed
The comparative run that family is pre-configured with performs analysis operation.
5. data handling system according to claim 4, it is characterised in that the client is being received from described clear
Look at after the data processing request of device generation and each corresponding operation reality at least one operation template respectively
Example, then start the related progress of work after the completion of the security authentication operation of correlation to realize the data with the destination host
Communication process, and store the results set file.
6. data handling system according to claim 5, it is characterised in that the client performs described as follows
Analysis operation：（1）Each instruction execution result in the results set file is divided into some subdomains；（2）For each
The subdomain performs predetermined analytic function to obtain the analysis result of Boolean form；（3）Collect the analysis for each subdomain
As a result, and by the analysis result of collected each subdomain applied to predetermined expression formula is studied and judged to obtain total analysis result；
（4）Total analysis result is fed back into the browser.
7. data handling system according to claim 6, it is characterised in that the predetermined analytic function uses following
Method of completing the square：Canonical matching, in full matching, line number matching and function matching.
8. data handling system according to claim 7, it is characterised in that in data handling system disclosed in this invention
In, the browser can receive the source file of the different content form of user's submission and send it to the client.
9. data handling system according to claim 8, it is characterised in that the source that the client storage receives
File simultaneously increases corresponding record in the corresponding traffic table of the database, and is matched somebody with somebody by the browser prompts user
The property value associated with the source file is put, is then imported into the source file and property value associated there described
In dictionary model in database.
10. data handling system according to claim 9, it is characterised in that perform knowledge file inquiry as follows
Process：（1）The browser is based on user instruction construction knowledge query request and is sent to knowledge query request described
Client, wherein, the knowledge query request bag contains query type；（2）The client asks institute according to the knowledge query
The query type of instruction inquires about the database and the record of acquisition is returned into the browser to be shown to user；（3）Institute
The identifier for stating the record that browser selects user sends the client to；（4）The client is according to the identifier
Obtain the property value of the source file that is stored in data model associated with the identifier, and by the property value and user
Selected record is matched, and matching result then is sent into the browser to be shown to use in the form of predefined
Family.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310609945.9A CN104679740B (en) | 2013-11-27 | 2013-11-27 | Data handling system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310609945.9A CN104679740B (en) | 2013-11-27 | 2013-11-27 | Data handling system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104679740A CN104679740A (en) | 2015-06-03 |
| CN104679740B true CN104679740B (en) | 2017-11-17 |
Family
ID=53314804
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310609945.9A Active CN104679740B (en) | 2013-11-27 | 2013-11-27 | Data handling system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104679740B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105760769B (en) * | 2016-03-14 | 2018-08-21 | 寇陶陶 | A kind of computer password statistical analysis technique and device |
| CN107357796B (en) * | 2016-05-10 | 2021-08-06 | 阿里巴巴（中国）有限公司 | Network information acquisition method, equipment and programmable equipment |
| CN109145092B (en) * | 2017-06-15 | 2022-05-17 | 阿里巴巴集团控股有限公司 | Database updating and intelligent question and answer management method, device and equipment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101834890A (en) * | 2010-04-02 | 2010-09-15 | 浪潮(北京)电子信息产业有限公司 | Intelligent management system and method of distributed system |
| CN102165419A (en) * | 2008-10-31 | 2011-08-24 | 国际商业机器公司 | Computer system, method, and computer program for managing batch job |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8920233B2 (en) * | 2006-11-10 | 2014-12-30 | Bally Gaming, Inc. | Assignment template and assignment bundle in a gaming configuration and download system |
| US8682752B2 (en) * | 2010-10-27 | 2014-03-25 | Oracle International Corporation | Integration of applications with a financial close management system |
-
2013
- 2013-11-27 CN CN201310609945.9A patent/CN104679740B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102165419A (en) * | 2008-10-31 | 2011-08-24 | 国际商业机器公司 | Computer system, method, and computer program for managing batch job |
| CN101834890A (en) * | 2010-04-02 | 2010-09-15 | 浪潮(北京)电子信息产业有限公司 | Intelligent management system and method of distributed system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104679740A (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110717319B (en) | Self-service report generation method, device, computing equipment and system | |
| EP2608074B1 (en) | Systems and methods for merging source records in accordance with survivorship rules | |
| Ding et al. | Ontology research and development. part 2-a review of ontology mapping and evolving | |
| US8386464B2 (en) | Configuration of optimized custom properties in a data finder tool | |
| US6826566B2 (en) | Identifier vocabulary data access method and system | |
| US9026901B2 (en) | Viewing annotations across multiple applications | |
| US8484230B2 (en) | Dynamic parsing rules | |
| US10069892B2 (en) | Versatile information management system and method thereof | |
| CN101655943B (en) | Enterprise application integrated working flow management method and system | |
| CN106649225A (en) | JSON self-definition-based report generation system and method | |
| US20080046838A1 (en) | Interactively Setting a Search Value in a Data Finder Tool | |
| CN102023989A (en) | Information retrieval method and system thereof | |
| US20080243776A1 (en) | System and method to facilitate real-time end-user awareness in query results through layer approach utilizing end-user interaction, loopback feedback, and automatic result feeder | |
| CN101901242A (en) | Federated configuration data management | |
| US11500871B1 (en) | Systems and methods for decoupling search processing language and machine learning analytics from storage of accessed data | |
| CN106982150A (en) | A kind of mobile Internet user behavior analysis method based on Hadoop | |
| CN112688865A (en) | Design method of OPC UA gateway for graphical online modeling | |
| US6957429B1 (en) | Service processing apparatus and service execution control method | |
| CN106802905B (en) | Collaborative data exchange method of isomorphic PLM system | |
| CN102955802B (en) | The method and apparatus of data is obtained from data sheet | |
| CN106687955A (en) | Simplifying invocation of import procedures to transfer data from data sources to data targets | |
| CN102917009A (en) | Method and system for collecting and storing stock data based on cloud computing technology | |
| CN104679740B (en) | Data handling system | |
| CN102346765B (en) | A kind of method of audit memory data and device | |
| CN104573053B (en) | A kind of configuration item template dynamic customization method based on XML |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |