CN107102905A - The platform and platform processes method of big data service based on Artifact - Google Patents
The platform and platform processes method of big data service based on Artifact Download PDFInfo
- Publication number
- CN107102905A CN107102905A CN201710242741.4A CN201710242741A CN107102905A CN 107102905 A CN107102905 A CN 107102905A CN 201710242741 A CN201710242741 A CN 201710242741A CN 107102905 A CN107102905 A CN 107102905A
- Authority
- CN
- China
- Prior art keywords
- service
- artifact
- platform
- execution engine
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000008569 process Effects 0.000 title claims abstract description 10
- 238000012545 processing Methods 0.000 claims abstract description 23
- 238000003672 processing method Methods 0.000 claims abstract description 15
- 239000002131 composite material Substances 0.000 claims description 49
- 239000000203 mixture Substances 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000001195 anabolic effect Effects 0.000 claims description 3
- 230000008676 import Effects 0.000 claims description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
- G06F9/548—Object oriented; Remote method invocation [RMI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/544—Remote
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a kind of platform of big data service based on Artifact and platform processes method.On the one hand, the invention provides a kind of processing method of the big data service platform based on Artifact, this method is related to service execution engine and message queue Rabbitmq, and it includes following process step:Step 101：User sends HTTP request to platform, and HTTP request, which is included, will call the address id and input parameter collection of service；Step 102：Platform is received after HTTP request, and request is sent into service execution engine by Rabbitmq；Step 103：Service execution engine finds out the service description document position according to the address id of service；Step 104：Service execution engine calls service according to service description document.On the other hand, the invention provides a kind of big data service platform based on Artifact.The present invention can effectively carry out big data and call service, improve processing speed.
Description
Technical field
The present invention relates to data processing field, more particularly to a kind of processing of the big data service platform based on Artifact
Method, further relates to a kind of big data service platform based on Artifact.
Background technology
In recent years, with the development of technology and network, people are to related computing capability, resource centralization, the utilization of resources
The requirement more and more higher of rate, thus, cloud computing is arisen at the historic moment so that people increasingly tend to application and service being deployed to cloud
In environment.At present, how effectively various services to be managed and called, be that the key that cloud computing faces is asked
Topic.Traditional web services method of calling has had many scholars to be studied, but with various big data services
Continue to bring out and web services method of calling is not directly applicable in big data service so that the spy serviced according to big data
Point, proposes a kind of service description document form, is adjusted with meeting to service big data according to service description document in cloud computing
It is required that being very necessary.
The research of services selection under traditional environment and combination has had certain progress, but current research still with
Traditional web services are used as research object.Also it is Services Composition however as continuing to bring out that various big datas are serviced
New challenge is brought, big data service there are the one sides different from web services due to the characteristic of itself, still, at present big number
It is different from web services metastable processing time according to servicing, shadow of the processing time that big data is serviced by input data amount
It is all longer to ring very big and processing time, simultaneously as traditional web services method of calling and combination can not be straight
Scoop out in big data service, thus the combination serviced big data be also under cloud environment Services Composition faced another
Key issue.
The content of the invention
The purpose of the present invention one is to provide a kind of platform processes method of the big data service based on Artifact, can have
Effect carries out big data and calls service, improves processing speed.
The purpose of the present invention two is to provide a kind of platform for realizing this method.
For realize the mesh one there is provided a kind of processing method of the big data service platform based on Artifact, the party
Method is related to service execution engine and message queue Rabbitmq, and it includes following process step:
Step 101：User sends HTTP request to platform, and HTTP request includes the address id that call service and input is joined
Manifold；
Step 102：Platform is received after HTTP request, and request is sent into service execution engine by Rabbitmq；
Step 103：Service execution engine finds out the service description document position according to the address id of service；
Step 104：Service execution engine calls service according to service description document.
Preferably, when in step 103, service execution engine is retouched according to what the address id of service was found out for composite service
The position of document is stated, composite service processing is carried out at step 104, the composite service processing includes following process step：
Step 401：Parsing composite service describes document；
Step 402：The input parameter name of composite service is split, corresponding information carrier is parsed respectively
The parameter value of import of services, is then assigned to the category in artifact by artifact title and attribute attribute title
Property attribute；
Step 403：The anabolic process of composite service processing uses event driven pattern, and first artifacts attributes are entered
Row monitoring, after attribute change in artifacts, updates artifacts state, the whole rule rules of inquiry, and detection is
It is no to there is rules to meet, if no rules meets, current state is kept, triggering after the completion of new composite service is continued waiting for
After new state change, rules is detected again, if the operation serviced in triggering operation flow service services if having, is called
External service, modifies after the completion of calling to the attribute in artifacts, when detecting the attribute status in artifacts
All enter after done state, Services Composition flow performs completion, and composite service calls end.
Preferably, in step 401, parsing composite service describes to generate an execution example after document, described to perform reality
The corresponding data structure of example includes warehouse Repository examples, the dictionary of Artifact models, rule Rule list, service
The dictionary of type.
Preferably, in step 403, artifacts attributes are monitored to carry out the dictionary of Artifact models
Monitoring；When the dictionary state for detecting Artifact models all enters done state, Services Composition flow performs completion, is combined clothes
End is called in business.
Preferably, the processing method of the platform calling by the way of mediator deputy to service, service execution engine is born
Duty is obtained after service request from platform, will ask to be converted into according to service request information to call Service Instance, invoked procedure
To search information on services according to request, corresponding contract of service is downloaded according to information on services, service is called according to contract of service.
Preferably, the processing method of the platform also by service execution engine to located at service execution engine external service collection
Group carries out service call.
To realize purpose two, a kind of big data service platform based on Artifact is additionally provided, including provide website circle
Administrative center that face and web interface are interacted to user, the service execution engine for service call, for transmission information
Message queue Rabbitmq, the administrative center carries out information transmission by message queue Rabbitmq and service execution engine.
Preferably, the platform also includes composite service actuator, and the composite service actuator is service execution engine
Subsystem.
Preferably, the platform also includes the service cluster outside service execution engine, the service cluster and clothes
Business enforcement engine connection.
Compared with prior art, its advantage is the present invention：
Administrative center goes to call the function of service execution engine according to the request of user by Rabbitmq in the present invention, can
Effectively carry out big data and call service, improve processing speed.Service execution engine can just be allowed by HTTP request in the present invention
Big data service and returning result are called according to service description document, handled more rapidly, succinctly.
Brief description of the drawings
Fig. 1 is platform structure block diagram of the invention；
Fig. 2 is platform processes method flow diagram of the invention；
Fig. 3 is the process flow figure of composite service actuator in the present invention.
Embodiment
With reference to embodiment, the invention will be further described, but does not constitute any limitation of the invention, any
The modification of the limited number of time made in scope of the invention as claimed, still in scope of the presently claimed invention.
As shown in Figure 1 and Figure 2, a kind of processing method of the big data service platform based on Artifact, it is characterised in that
This method is related to service execution engine 3 and message queue Rabbitmq2, and it includes following process step:
Step 101：User sends HTTP request to platform, and HTTP request includes the address id that call service and input is joined
Manifold；
Step 102：Platform is received after HTTP request, and request is sent into service execution engine by Rabbitmq2；
Step 103：Service execution engine 3 finds out the service description document position according to the address id of service；
Step 104：Service execution engine 3 calls service according to service description document.
As shown in figure 3, ought in step 103, service execution engine takes according to what the address id of service was found out to be compound
The position of business description document, carries out composite service processing at step 104, and the composite service processing includes following processing step
Suddenly：
Step 401：Parsing composite service describes document；
Step 402：The input parameter name of composite service is split, corresponding information carrier is parsed respectively
The parameter value of import of services, is then assigned to the category in artifact by artifact title and attribute attribute title
Property attribute；
Step 403：The anabolic process of composite service processing uses event driven pattern, and first artifacts attributes are entered
Row monitoring, after attribute change in artifacts, updates artifacts state, the whole rule rules of inquiry, and detection is
It is no to there is rules to meet, if no rules meets, current state is kept, triggering after the completion of new composite service is continued waiting for
After new state change, rules is detected again, if the operation serviced in triggering operation flow service services if having, is called
External service, modifies after the completion of calling to the attribute in artifacts, when detecting the attribute status in artifacts
All enter done state, Services Composition flow performs completion, and composite service calls end.
In the present embodiment, it is that the form based on service description document is write that composite service, which describes document, is retouched in composite service
Several service description documents can be included by stating in document, can be by several in the invoked procedure that composite service describes document
Services Composition to being called together, it is possibility to have sequencing must be called.
In the present embodiment, when the operation serviced in triggering operation flow service services, external service is called, is called
After the completion of the attribute in artifacts is modified, and artifacts states are modified, then proceed to detection
Whether the attribute status in artifacts all enters done state.
In step 401, parsing composite service describes to generate an execution example after document, performs the corresponding data of example
Structure includes warehouse Repository examples, the dictionary of Artifact models, rule Rule list, the dictionary of service type.
It is the concrete operations processing event or flow that composite service is handled to perform example.
In step 403, artifacts attributes are monitored and be monitored for the dictionary to Artifact models；When
The dictionary state for detecting Artifact models all enters after done state, and Services Composition flow performs completion, and composite service is adjusted
With end.
In the present embodiment, composite service processing is responsible for describing composite service document being parsed and performed service
The flow of combination.
The processing method of the platform is called by the way of mediator deputy to service, and service execution engine 3 is responsible for from flat
Platform is obtained after service request, will ask to be converted into according to service request information to call Service Instance, according to invoked procedure
Information on services is searched in request, downloads corresponding contract of service according to information on services, service is called according to contract of service.
The processing method of the platform is entered for 3 pairs also by service execution engine located at the external service cluster 4 of service execution engine 3
Row service call.
As shown in figure 1, present invention also offers a kind of big data service platform based on Artifact, including website is provided
Administrative center 1 that interface and web interface are interacted to user, the service execution engine 3 for service call, for transmitting letter
The message queue Rabbitmq2 of breath, the administrative center 1 is believed by message queue Rabbitmq2 with service execution engine 3
Breath transmission.
In the present embodiment, user is operated on webpage, and administrative center 1 will pass through according to the operation of user
Rabbitmq2 is gone to call the function of service execution engine 3, and result is returned into user immediately.Administrative center 1 only needs to please
Ask and be sent in message queue Rabbitmq2, the node of service execution engine 3 will be pulled from message queue ask and carry out from
Reason, when there is multiple nodes while listening for individual queue, data can also uniformly be transported to and give each node by message queue, protect
The load balancing of each node is demonstrate,proved.The platform is responsible for the form called using mediator deputy of service, service execution engine 3
Obtained from administrative center 1 after service request, will ask to be converted into according to service request information to call Service Instance, called
Journey is to search information on services according to request, downloads corresponding contract of service according to information on services, service is called according to contract of service.
Rabbitmq2 causes the computing capability by increasing number of servers with regard to energy expansion service enforcement engine 3, greatly improves transverse direction
Extended capability；Asynchronous call is carried out using Rabbitmq3 and ensure that the request of the timely feedback user of administrative center 1 solves clothes
The problem of long the time required to when business enforcement engine 3 calls the big data to service.
The platform also includes composite service actuator, and the composite service actuator is the subsystem of service execution engine 3.
The platform also includes the service cluster 4 outside service execution engine 3, and the service cluster 4 connects with service execution engine 3
Connect.
In the present embodiment, the composite service actuator is responsible for describing composite service document and being parsed and performed clothes
The flow of business combination.Composite service actuator is used based on event-driven design architecture and realized using JAVA.
The workflow of the present embodiment：User sends HTTP request to service management center 1, and HTTP request is included and called
Address of service id and input parameter collection；Administrative center 1 is received after HTTP request, and request is sent to by Rabbitmq2
Service execution engine 3；Service execution engine 3 finds out the service description document position according to address of service and service execution is drawn
Hold up 3 and information on services is searched according to request, corresponding contract of service is then downloaded according to information on services, further according to contract of service from clothes
Business cluster 4 calls service.When processing describes document to composite service, service execution engine 3 is entered using composite service actuator
Row processing.Composite service actuator parsing composite service describes document, and parsing corresponding data structure includes warehouse
Repository examples, the dictionary of Artifact models preserves rule Rule list, the dictionary of service type；By service
Input parameter name is split, and parses corresponding information carrier artifact and attribute attribute title, then will clothes
The value of business input parameter is assigned to the attribute attribute in artifact；Services Composition process is by using event driven mould
Formula, is monitored to the dictionary of Artifact models, after attribute change in artifacts, updates artifacts shape
State, traversal rule rules detects whether that regular rules meets, and has the service in then triggering operation flow service services
Operation calls external service, the attribute in artifacts is modified after the completion of calling, when detecting Artifact models
Dictionary state all enter done state after, Services Composition flow performs completion, and composite service calls end.
Big data can effectively be carried out by the present invention and call service, processing speed is improved.
It the above is only the preferred embodiment of the present invention, it should be pointed out that for those skilled in the art, do not taking off
On the premise of from structure of the present invention, several modifications and improvements can also be made, these effects implemented all without the influence present invention
And practical applicability.
Claims (9)
1. a kind of processing method of the big data service platform based on Artifact, it is characterised in that this method is related to service
Enforcement engine and message queue Rabbitmq, it includes following process step:
Step 101：User sends HTTP request to platform, and HTTP request, which is included, will call the address id and input parameter of service
Collection；
Step 102：Platform is received after HTTP request, and request is sent into service execution engine by Rabbitmq；
Step 103：Service execution engine finds out the service description document position according to the address id of service；
Step 104：Service execution engine calls service according to service description document.
2. a kind of processing method of big data service platform based on Artifact according to claim 1, its feature exists
In, when in step 103, the position that document is described for composite service that service execution engine is found out according to the address id of service
Put, composite service processing is carried out at step 104, the composite service processing includes following process step：
Step 401：Parsing composite service describes document；
Step 402：The input parameter name of composite service is split, parses corresponding information carrier artifact's respectively
The parameter value of import of services, is then assigned to the attribute in artifact by the title of title and attribute attribute
attribute；
Step 403：The anabolic process of composite service processing uses event driven pattern, and first artifacts attributes are supervised
Control, after attribute change in artifacts, updates artifacts state, the whole rule rules of inquiry, has detected whether
Rules meets, if no rules meets, keeps current state, continues waiting for triggering newly after the completion of new composite service
After state change, rules is detected again, if the operation serviced in triggering operation flow service services if having, calls outside
Service, modifies to the attribute in artifacts after the completion of calling, all enters when detecting the attribute status in artifacts
Enter done state, Services Composition flow performs completion, and composite service calls end.
3. a kind of processing method of big data service platform based on Artifact according to claim 2, its feature exists
In in step 401, parsing composite service describes to generate an execution example, the corresponding data of the execution example after document
Structure includes warehouse Repository examples, the dictionary of Artifact models, rule Rule list, the dictionary of service type.
4. a kind of processing method of big data service platform based on Artifact according to claim 3, its feature exists
In in step 403, being monitored and be monitored for the dictionary to Artifact models to artifacts attributes；When detecting
The dictionary state of Artifact models all enters done state, and Services Composition flow performs completion, and composite service calls end.
5. a kind of processing method of big data service platform based on Artifact according to claim 1, its feature exists
In processing method the calling by the way of mediator deputy to service of the platform, service execution engine is responsible for obtaining from platform
After service request, it will ask to be converted into according to service request information to call Service Instance, invoked procedure is to be looked into according to request
Information on services is looked for, corresponding contract of service is downloaded according to information on services, service is called according to contract of service.
6. a kind of processing method of the big data service platform based on Artifact, the platform according to claim 1 or 5
Processing method also by service execution engine to located at service execution engine external service cluster carry out service call.
7. a kind of big data service platform according to claim 1 based on Artifact, it is characterised in that including providing
Administrative center that web station interface and web interface are interacted to user, the service execution engine for service call, for transmitting
Row information is entered by message queue Rabbitmq and service execution engine by the message queue Rabbitmq of information, the administrative center
Transmission.
8. a kind of big data service platform based on Artifact according to claim 7, it is characterised in that：The platform is also
Including composite service actuator, the composite service actuator is the subsystem of service execution engine.
9. a kind of big data service platform based on Artifact according to claim 7 or 8, it is characterised in that this is put down
Platform also includes the service cluster outside service execution engine, and the service cluster is connected with service execution engine.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710242741.4A CN107102905B (en) | 2017-04-13 | 2017-04-13 | Artifect-based big data service platform and platform processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710242741.4A CN107102905B (en) | 2017-04-13 | 2017-04-13 | Artifect-based big data service platform and platform processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107102905A true CN107102905A (en) | 2017-08-29 |
| CN107102905B CN107102905B (en) | 2020-08-11 |
Family
ID=59674811
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710242741.4A Active CN107102905B (en) | 2017-04-13 | 2017-04-13 | Artifect-based big data service platform and platform processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107102905B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030097454A1 (en) * | 2001-11-02 | 2003-05-22 | Nec Corporation | Switching method and switch device |
| CN102025653A (en) * | 2010-06-04 | 2011-04-20 | 西本新干线股份有限公司 | Enterprise service bus and message processing method thereof |
| CN102088475A (en) * | 2010-11-29 | 2011-06-08 | 东北大学 | System and method for executing combined service with centralized control flow and distributed data flow |
| CN103853727A (en) * | 2012-11-29 | 2014-06-11 | 深圳中兴力维技术有限公司 | Method and system for improving large data volume query performance |
| CN105991694A (en) * | 2015-02-05 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Method and device for realizing distributed service invocation |
-
2017
- 2017-04-13 CN CN201710242741.4A patent/CN107102905B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030097454A1 (en) * | 2001-11-02 | 2003-05-22 | Nec Corporation | Switching method and switch device |
| CN102025653A (en) * | 2010-06-04 | 2011-04-20 | 西本新干线股份有限公司 | Enterprise service bus and message processing method thereof |
| CN102088475A (en) * | 2010-11-29 | 2011-06-08 | 东北大学 | System and method for executing combined service with centralized control flow and distributed data flow |
| CN103853727A (en) * | 2012-11-29 | 2014-06-11 | 深圳中兴力维技术有限公司 | Method and system for improving large data volume query performance |
| CN105991694A (en) * | 2015-02-05 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Method and device for realizing distributed service invocation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107102905B (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102185901B (en) | Client message conversion method | |
| CN104199957B (en) | A kind of implementation method of Redis general-purpose proxies | |
| WO2022135079A1 (en) | Data processing method for task flow engine, and task flow engine, device and medium | |
| US9324033B2 (en) | Method and apparatus for providing standard data processing model through machine learning | |
| CN112527528A (en) | Data transmission method, device and storage medium based on message queue | |
| WO2019154353A1 (en) | System running parameter query method, matching method and apparatus, and node device | |
| US8266630B2 (en) | High-performance XML processing in a common event infrastructure | |
| CN101382893B (en) | On-line assembling method for component based on Web service | |
| WO2012152132A1 (en) | Method and system for realizing application platform adaptation | |
| WO2020228063A1 (en) | Method and device for developing service functions | |
| CN108845798A (en) | A kind of visualization big data task cradle and processing method | |
| CN103716356B (en) | Storing process operating method, device and system based on web | |
| CN109656688A (en) | A kind of method that realizing distributed service rule, system and server | |
| US7966625B2 (en) | Extending web service description language for SIP/call flow interactions | |
| CN112445868B (en) | Service message processing method and device | |
| CN106686021A (en) | Service invoking method and gateway | |
| JP2018537777A (en) | Internet of things information system | |
| CN110096258A (en) | A method of the OpenStack infrastructure architecture management based on Terraform | |
| CN106897060A (en) | Based on patterned data processing method and device | |
| EP2979173B1 (en) | Object life cycle management in a publish-subscribe environment | |
| CN103561113B (en) | The generation method and device of Web Service interface | |
| CN107102905A (en) | The platform and platform processes method of big data service based on Artifact | |
| CN116932147A (en) | Streaming job processing method and device, electronic equipment and medium | |
| CN110768818B (en) | Network management method and device | |
| CN111104122A (en) | Method for mapping xml service logic to java service logic |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |