CN105404516A - Data analysis method for service integration - Google Patents
Data analysis method for service integration Download PDFInfo
- Publication number
- CN105404516A CN105404516A CN201510884067.0A CN201510884067A CN105404516A CN 105404516 A CN105404516 A CN 105404516A CN 201510884067 A CN201510884067 A CN 201510884067A CN 105404516 A CN105404516 A CN 105404516A
- Authority
- CN
- China
- Prior art keywords
- data
- mode
- static
- business integration
- analytic method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
- G06F8/22—Procedural
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/37—Compiler construction; Parser generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
- H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention discloses a data analysis method for service integration. The data analysis method for service integration comprises: extracting data, determining a data type, and performing the following operations according to the data type; in a case that the data is an object that can be dynamically analyzed, writing a script to analyze the data into a program code by using a scripting engine and then storing the program code; or in a case that the data is static data or semi-static data, using a client cache to cache the static or semi-static data. The data analysis method for service integration overcomes the problem of inefficient service data processing in the prior art, and can process service data with high efficiency and low pressure.
Description
Technical field
The present invention relates to the method field of the dissection process of business datum, particularly, relate to a kind of business integration data analytic method.
Background technology
Foundational development platform is a kind of SDK (Software Development Kit), and it is based on current techique framework (ORM, IOC, MVC), and integrated conventional modeling tool, secondary development bag, basic solution etc. form.Instrument significantly can reduce encoding rate, makes developer have the more time to pay close attention to customer demand, all can provide powerful support in each stage such as demand, design, exploitation, test, deployment, maintenance of project.
Foundational development platform derives from loaded down with trivial details to be put into practice in performance history, has converged the summary of auspicious letter software Experiences in Developing Software during the last ten years.Due to this type of platform to the lifting of enterprise core competence clearly, management software market domestic at present, the application of Software Development Platform has become a kind of trend.
Based on above-mentioned reason, how to solve the dumb of platform processes business datum, reduce the transmission quantity of network data, alleviate platform burden, the efficiency increasing business data processing becomes a kind of problem needing solution badly.
Summary of the invention
The object of this invention is to provide a kind of business integration data analytic method, this business integration data analytic method overcomes business data processing of the prior art and to get up the not high problem of efficiency, achieves efficient, the process business datum of low-pressure.
To achieve these goals, the invention provides a kind of business integration data analytic method, this business integration data analytic method comprises:
Extracted data, decision data type, performs following operation respectively according to data type;
When data be can the object of dynamic analysis, adopt the mode of compile script by script engine Data Analysis become program code and store; Or
When data be static data or semi-static data, adopt client-cache, caching process carried out to static or semi-static data.
Preferably, the method for client-cache is adopted to comprise:
Client is adopted to carry out buffer memory by the caching mechanism in http protocol to static data or semi-static data.
Preferably, the method for extracted data comprises:
The data extracted are downloaded: file mode, File Transfer Protocol, WebService mode, database mode, message mode, Socket mode and html page mode by following any one or various ways.
Preferably, this business integration data analytic method also comprises:
When data are the object participating in exchanges data and statistics, the mode of incremental data is adopted to reduce the data volume of computing.
Preferably, this business integration data analytic method also comprises:
Be when can carry out the object of STRUCTURE DECOMPOSITION in data, adopt the mode of space for time that the nonlinear relationship of complexity is decomposed into simple linear relationship.
Preferably, the method for described extracted data comprises:
By statistical conversion in file, then file is placed on ftp server, downloads extracted data by File Transfer Protocol.
By above-mentioned embodiment, business integration data analytic method of the present invention adopts template program to change the structure of definition and configuration into code and data integrated program, reach dirigibility and high performance dual purpose, the present invention is achieving the dirigibility of height, and achieve on extendability and high performance basis, greatly can also alleviate the load pressure of server, increase the transfer efficiency of client.
Other features and advantages of the present invention are described in detail in embodiment part subsequently.
Accompanying drawing explanation
Accompanying drawing is used to provide a further understanding of the present invention, and forms a part for instructions, is used from explanation the present invention, but is not construed as limiting the invention with embodiment one below.In the accompanying drawings:
Fig. 1 is the process flow diagram of the business integration data analytic method that a kind of preferred implementation of the present invention is described.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in detail.Should be understood that, embodiment described herein, only for instruction and explanation of the present invention, is not limited to the present invention.
The invention provides a kind of business integration data analytic method, this business integration data analytic method comprises:
Extracted data, decision data type, performs following operation respectively according to data type;
When data be can the object of dynamic analysis, adopt the mode of compile script by script engine Data Analysis become program code and store; Or
When data be static data or semi-static data, adopt client-cache, caching process carried out to static or semi-static data.
The present invention, for can the object of dynamic analysis, adopts the mode of compile script to resolve to program code and storing process by script engine, realizes the dirigibility of height, extendability and high-performance.For static and semi-static data, utilize client-cache to improve performance, employing client-cache had both decreased the volume of transmitted data on network, made full use of again the computational resource of client, greatly can alleviate the load pressure of server.
Below in conjunction with accompanying drawing, 1 couple of the present invention is further detailed, and in the present invention, in order to improve the scope of application of the present invention, pain is special uses following embodiment to realize.
In a kind of embodiment of the present invention, the method for client-cache is adopted to comprise:
Client is adopted to carry out buffer memory by the caching mechanism in http protocol to static data or semi-static data.
Cache model is optimization means, improves the speed of customer terminal webpage operation.In foundational development platform, for improving the access efficiency of system, we introduce client-side data cache model, caching process is carried out to the static state in list or semi-static data, the core of model is the caching mechanism in http protocol, because this mechanism supported all completely by the browser (IE, Firefox, Chrome etc.) of current main flow, so the client-side data cache model after realizing can use by browser-cross platform.By above-mentioned mode, 1, can the network bandwidth be reduced, if service end file does not change, program directly reads data from client-cache; 2 can reduce service end loads the disk I/O that static file and needing carries out; 3 can improve program operational efficiency, and especially use in the list of caching data on client a large amount of, its display and operating speed can be significantly increased.
In a kind of embodiment of the present invention, the method for extracted data can comprise:
The data extracted are downloaded: file mode, File Transfer Protocol, WebService mode, database mode, message mode, Socket mode and html page mode by following any one or various ways.
Extracted file is carried out by above-mentioned 7 kinds of modes, wherein,
1. file mode
To method, system derived data in file, then data file is placed into the appointment of file server
In catalogue, file layout supports Excel, to specify separator (space, comma, tab key) point
Every the form such as txt file.
2. FTP mode
Also be by statistical conversion in file, be then placed on ftp server by file, program downloads specified file by File Transfer Protocol.
3. WebService mode
Data are obtained by the WebService called method, system is issued.
4. database mode
The database of direct access to method, system obtains data.
5. message mode
The exchanges data of high efficient and reliable is realized by message-oriented middleware.
6. Socket mode
Realize a two-way network service by TCPSocket technology to connect and obtain data.
7. html page mode
Visit the page to method, system by http protocol, resolve content of pages thus obtain data.
In a kind of embodiment of the present invention, this business integration data analytic method also comprises:
When data are the object participating in exchanges data and statistics, the mode of incremental data is adopted to reduce the data volume of computing.
By the way, for the object that can carry out STRUCTURE DECOMPOSITION, adopt the strategy of space for time that the nonlinear relationship of complexity is decomposed into simple linear relationship, promote program operational efficiency.
In a kind of embodiment of the present invention, this business integration data analytic method also comprises:
Be when can carry out the object of STRUCTURE DECOMPOSITION in data, adopt the mode of space for time that the nonlinear relationship of complexity is decomposed into simple linear relationship.
By above-mentioned embodiment, for the business object participating in exchanges data and statistics, the strategy of incremental data is adopted to reduce the data volume of computing.
In a kind of embodiment of the present invention, the method for described extracted data comprises:
By statistical conversion in file, then file is placed on ftp server, downloads extracted data by File Transfer Protocol.
Below the preferred embodiment of the present invention is described in detail by reference to the accompanying drawings; but; the present invention is not limited to the detail in above-mentioned embodiment; within the scope of technical conceive of the present invention; can carry out multiple simple variant to technical scheme of the present invention, these simple variant all belong to protection scope of the present invention.
It should be noted that in addition, each concrete technical characteristic described in above-mentioned embodiment, in reconcilable situation, can be combined by any suitable mode, in order to avoid unnecessary repetition, the present invention illustrates no longer separately to various possible array mode.
In addition, also can carry out combination in any between various different embodiment of the present invention, as long as it is without prejudice to thought of the present invention, it should be considered as content disclosed in this invention equally.
Claims (6)
1. a business integration data analytic method, is characterized in that, this business integration data analytic method comprises:
Extracted data, decision data type, performs following operation respectively according to data type;
When data be can the object of dynamic analysis, adopt the mode of compile script by script engine Data Analysis become program code and store; Or
When data be static data or semi-static data, adopt client-cache, caching process carried out to static or semi-static data.
2. business integration data analytic method according to claim 1, is characterized in that, adopts the method for client-cache to comprise:
Client is adopted to carry out buffer memory by the caching mechanism in http protocol to static data or semi-static data.
3. business integration data analytic method according to claim 1, it is characterized in that, the method for extracted data comprises:
The data extracted are downloaded: file mode, File Transfer Protocol, WebService mode, database mode, message mode, Socket mode and html page mode by following any one or various ways.
4. business integration data analytic method according to claim 1, is characterized in that, this business integration data analytic method also comprises:
When data are the object participating in exchanges data and statistics, the mode of incremental data is adopted to reduce the data volume of computing.
5. business integration data analytic method according to claim 1, is characterized in that, this business integration data analytic method also comprises:
Be when can carry out the object of STRUCTURE DECOMPOSITION in data, adopt the mode of space for time that the nonlinear relationship of complexity is decomposed into simple linear relationship.
6. business integration data analytic method according to claim 1, it is characterized in that, the method for described extracted data comprises:
By statistical conversion in file, then file is placed on ftp server, downloads extracted data by File Transfer Protocol.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510884067.0A CN105404516A (en) | 2015-12-01 | 2015-12-01 | Data analysis method for service integration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510884067.0A CN105404516A (en) | 2015-12-01 | 2015-12-01 | Data analysis method for service integration |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105404516A true CN105404516A (en) | 2016-03-16 |
Family
ID=55470019
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510884067.0A Pending CN105404516A (en) | 2015-12-01 | 2015-12-01 | Data analysis method for service integration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105404516A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101441631A (en) * | 2007-11-19 | 2009-05-27 | 上海新纳广告传媒有限公司 | Data access method for asynchronous web page browsing |
| CN102438045A (en) * | 2011-12-07 | 2012-05-02 | 深圳市深信服电子科技有限公司 | Method and system for pre-fetching web page, and method for accessing web page |
| CN104601691A (en) * | 2015-01-13 | 2015-05-06 | 北京中交兴路车联网科技有限公司 | Method and system for increasing loading speed of Web site resource |
-
2015
- 2015-12-01 CN CN201510884067.0A patent/CN105404516A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101441631A (en) * | 2007-11-19 | 2009-05-27 | 上海新纳广告传媒有限公司 | Data access method for asynchronous web page browsing |
| CN102438045A (en) * | 2011-12-07 | 2012-05-02 | 深圳市深信服电子科技有限公司 | Method and system for pre-fetching web page, and method for accessing web page |
| CN104601691A (en) * | 2015-01-13 | 2015-05-06 | 北京中交兴路车联网科技有限公司 | Method and system for increasing loading speed of Web site resource |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106022483B (en) | The method and apparatus converted between machine learning model | |
| CN102938776A (en) | Dynamic page processing system based on Asynchronous JavaScript and XML (ajax) technique | |
| CN106776761B (en) | Method and device for rendering webpage by mobile browser | |
| CN101079041A (en) | Dynamic web page updating method and system | |
| CN104731589A (en) | Automatic generation method and device of user interface (UI) | |
| CN103092581A (en) | Method and device for setting up Web front-end local development environment | |
| US20150205637A1 (en) | Method of executing parallel application on manycore cluster system and the manycore cluster system | |
| CN103491169A (en) | Method and system for uploading and downloading files | |
| CN102023856A (en) | Method for outputting and operating data at server in formatting way according to demands of user | |
| CN106293675A (en) | Static system resource loading method and device | |
| CN105045856A (en) | Hadoop-based data processing system for big-data remote sensing satellite | |
| Pande et al. | Enhanced web application and browsing performance through service-worker infusion framework | |
| CN104144202A (en) | Hadoop distributed file system access method, system and device | |
| US11500652B2 (en) | Method and system for application loading | |
| CN102437894A (en) | Method, device and equipment for compressing information to be sent | |
| CN102882988A (en) | Method, device and equipment for acquiring address information of resource information | |
| CN103561082B (en) | Compressing request processing method and server | |
| CN111723314B (en) | Webpage display method and device, electronic equipment and computer readable storage medium | |
| CN105550238A (en) | Architecture system of database appliance | |
| CN111680799A (en) | Method and apparatus for processing model parameters | |
| CN106502757A (en) | A kind of plug-in management method and device | |
| CN102156697A (en) | Method and terminal equipment for realizing webpage application through widget | |
| CN110493250A (en) | A kind of WEB front-end ARCGIS resource request processing method and processing device | |
| CN105094787B (en) | Method and device for processing enterprise internet application | |
| CN103458037A (en) | Method and device for providing complex web applications in resource-constrained environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160316 |
|
| RJ01 | Rejection of invention patent application after publication |