CN112948152A - Method for processing and interface service of arranging data and calling - Google Patents
Method for processing and interface service of arranging data and calling Download PDFInfo
- Publication number
- CN112948152A CN112948152A CN202110413134.6A CN202110413134A CN112948152A CN 112948152 A CN112948152 A CN 112948152A CN 202110413134 A CN202110413134 A CN 202110413134A CN 112948152 A CN112948152 A CN 112948152A
- Authority
- CN
- China
- Prior art keywords
- node
- data
- service
- calling
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention relates to the technical field of computers, and discloses a method for arranging data processing and interface service and calling, aiming at solving a series of problems that the development, adjustment, test, deployment and the like are needed manually due to various uncertainties and changes when data docking is carried out between services; the method comprises the steps of dynamically generating an http service interface, calling an http request, calling a webservice service interface, calling a webservice request, timing tasks, subscribing and publishing messages, generating sql to perform data warehousing and interconversion of various different data formats and structures, arranging and serially connecting all the functions into a data flow, and performing condition judgment routing selection according to a running value in the arranging process, so that convenient and effective processing is realized, and the cost investment of customizing and developing the interface is greatly reduced.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method for processing, serving and calling arrangement data.
Background
With the continuous development of information technology, the demand of informatization in enterprises is more and more vigorous, different systems are constructed according to different services, and after a new system is completed, the new system is often required to be docked with the existing system, the existing system is different in development time and development teams, the data formats adopted during communication between the used technology stack and the interfaces may be different, the data structures during communication may also be different, but the data range required to be docked by the system is relatively clear, so that three problems can be caused:
firstly, some service adopted technical stacks are webservice, data communication is carried out, a newly-mounted system is required to provide a webservice interface for the calling and data pushing of the existing system, some existing service provides the webservice interface for the new-mounted system to inquire data, similarly, two modes of pushing and pulling exist for acquiring data, the two modes are only aimed at one communication frame, and if the newly-mounted system adopts no webservice in the technical stacks, research personnel need to customize and develop by introducing the webservice;
secondly, if the newly-built system provides a corresponding data interface for the system A to inquire according to the existing system A, but another existing system B needs to push data to the newly-built system at regular time, and then research personnel need to develop a regular task and call the interface;
and thirdly, after the interface is developed each time, the system is required to be redeployed to enable the interface to take effect.
The problems existing in the butt joint of the services are briefly listed, the method can realize convenient and effective processing, and the cost investment of the customized development interface is greatly reduced.
Based on the patent, a data routing flow can be arranged, a transparent proxy is formed between a calling party and a called party, or two passively called interfaces are connected in series, after an interface A is called, data returned by the interface A is used as a parameter of a calling interface B after data processing is carried out, calling is carried out, after the data routing flow is created or modified, only a deployment button needs to be clicked, the deployment of the data routing is carried out, and the whole routing process is repeated without restarting the application.
Disclosure of Invention
The invention aims to provide a method for processing, serving and calling layout data, which aims to solve the problems that in the background technology, butt joint of different interfaces needs to be artificially customized and developed to deal with the inconsistency of communication protocols between services and the conversion of data formats.
In order to achieve the technical purpose and achieve the technical effect, the invention discloses a method for processing, servicing and calling layout data, which comprises but is not limited to (http service nodes, http interface calling nodes, webservice service nodes, webservice interface calling nodes, timing task nodes, sql database operation nodes, message queue issuing message nodes and message queue consuming nodes) and data processing nodes, including but not limited to (json and xml conversion, json and map, xml and map conversion, data structure conversion and xpath extraction xml), and the specific implementation steps are as follows:
s1, firstly, creating service nodes according to the requirement, wherein the service nodes comprise http service interface nodes, webservcie service interface nodes, timer nodes and message subscription nodes, and the service nodes are characterized in that data can flow into the whole data routing process; a data route must have a service node;
s2, creating data processing node or data conversion node according to need, processing data in the service node flowing into the data route, such as data format conversion or data structure conversion, if the data does not need conversion, the data processing node or data conversion node may not be needed;
s3, creating a branch node according to the requirement, and carrying out logic judgment on the data output by the previous node to decide which node to flow to next step, wherein if the data only has one flow direction, the branch node does not need to be created;
s4, creating a calling service request node according to the requirement, wherein the calling service request node comprises an http request node, a web service request node, a message issuing node and an sql data operation node, and the calling service node is characterized in that the calling service node can call the corresponding service node by taking data as a parameter and obtain return information, and if the data does not need to be taken as the parameter to call the service, the calling service does not need to be created;
s5, repeating S1-S4 as required, and connecting each node to indicate from which service flows to which service;
s6, analyzing according to the arrangement of the user, and finding out the starting node (platform interface) in the flow definition;
s7, performing deep traversal by using a start node, wherein the start node is only a service node, so that a corresponding service is created according to the type of the service, http _ server dynamically creates an http service through netty, webservice _ server dynamically generates an interface through javascript first, then creates a webservice through apache cxf based on the dynamically generated interface, and other services call corresponding components to create corresponding services in the same way;
s8, traversing the nodes connected with the previous node, if the current node is a service node, because only one platform interface is provided, other service nodes can only be external interface nodes, http _ client can create http request through the netty, webservice _ client can create webservice client through cxf, and other servers call corresponding components to create corresponding calls;
s9, if the traversed current node is a data processing node, creating a corresponding data processor according to the type of data processing, if json ToMap is used, json is converted through jackson, and other data processing is similar;
s10, if the traversed current node is a data conversion node, traversing according to the source data format and the target data format mapping configured by the user and each field of the source data, if the field is configured with an expression, analyzing according to the expression to obtain a corresponding value as a value of a target field corresponding to the source field, if the field is configured with a conditional expression, performing condition judgment first, and if the condition is not satisfied, skipping the field;
s11, according to the data route definition, each service node, data processing node and data conversion node created by the corresponding node are connected in series according to the arrangement sequence;
s12, in the process of the runtime data receiving the data through the service node for circulation, the output of the previous node will be used as the input parameter of the next node.
The steps of S2-S4 may be repeated as needed for the service, and the remaining nodes may be freely combined as needed, except that the originating node for the data stream must be present.
The invention has the beneficial effects that:
1. the invention can be used for the butt joint of any interface except for the serial connection of the interfaces which do not support two or more active requests,
2. the invention can carry out any conversion aiming at different data formats and structures of different interfaces, including but not limited to json and xml conversion, json and map, xml and map conversion, data structure conversion, xpath extraction xml and data structure conversion.
Drawings
FIG. 1 is a block flow diagram of an embodiment of the present invention.
Fig. 2 is an operation interface diagram of data routing configuration in the present invention.
FIG. 3 is a diagram of a setting interface of a data conversion node according to the present invention.
Fig. 4 is a parameter setting interface diagram of the rest of nodes in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments.
As shown in FIG. 1, the invention discloses a method for arranging data processing and interface service and calling, which aims to solve the problems that in the background art, different interfaces need to be artificially customized and developed to deal with the inconsistency of communication protocols among services and the conversion of data formats, and the data interfaces in the process are connected in series to achieve the aim of a data processing transparent proxy by configuring a data routing process by a user. The method helps the user to quickly dock different interfaces of different applications without restarting the applications.
Fig. 2 is an operation interface diagram configured for data routing.
Wherein, the left line frame in fig. 2 is a node tool area of the data stream, and the corresponding node can be pushed into the right design area as required;
the right-hand box in fig. 2 is the design area of the data stream where all node choreographies operate;
1. taking fig. 2 as an example, the platform interface is a service node, and the external interface is an interface calling node;
2. double-clicking the nodes in the designer pops up a parameter setting page of the nodes, wherein the setting interface of the data conversion nodes is shown in fig. 3, and the parameter setting interfaces of the other nodes are shown in fig. 4;
3. the user selects the type of the node according to the requirement, which may be HTTP _ SERVER, webserver _ SERVER, etc., as the previously listed type, wherein the parameter setting interface of the data processing node is also fig. 4, but the component type list may select different options from those of the interface node (including the service interface and the call interface), the options include but are not limited to json toxml, json tomap, xml tojson, xml tomap, Xpath;
4. after a user configures a data routing process and a data processing rule, clicking a saved chart at the upper left corner of fig. 2, saving the routing process, starting a data routing through a deployment button of a system by using the defined data routing process, enabling the whole data flow to be effective, and starting to provide services.
The above description is only a preferred way of interfacing between services, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention shall be covered by the scope of the present invention.
Claims (1)
1. A method for arranging data processing and interface service and calling is provided, which aims to solve the problems of manual development, adjustment, test, deployment and the like caused by various uncertainties and changes when data docking is carried out between services, and is characterized in that: the method comprises the following steps of dynamically generating an http service interface, calling an http request, calling a webservice service interface, calling a webservice request, timing tasks, subscribing and publishing messages, generating sql to perform data warehousing and interconversion of various different data formats and structures, arranging and serially connecting all the functions into a data flow, and performing condition judgment and routing selection according to a running value in the arranging process, wherein the specific implementation steps are as follows:
s1, firstly, creating service nodes according to the requirement, wherein the service nodes comprise http service interface nodes, webservcie service interface nodes, timer nodes and message subscription nodes, and the service nodes are characterized in that data can flow into the whole data routing process; a data route must have a service node;
s2, creating data processing node or data conversion node according to need, processing data in the service node flowing into the data route, such as data format conversion or data structure conversion, if the data does not need conversion, the data processing node or data conversion node may not be needed;
s3, creating a branch node according to the requirement, and carrying out logic judgment on the data output by the previous node to decide which node to flow to next step, wherein if the data only has one flow direction, the branch node does not need to be created;
s4, creating a calling service request node according to the requirement, wherein the calling service request node comprises an http request node, a web service request node, a message issuing node and an sql data operation node, and the calling service node is characterized in that the calling service node can call the corresponding service node by taking data as a parameter and obtain return information, and if the data does not need to be taken as the parameter to call the service, the calling service does not need to be created;
s5, repeating S1-S4 as required, and connecting each node to indicate from which service flows to which service;
s6, analyzing according to the arrangement of the user, and finding out the starting node (platform interface) in the flow definition;
s7, performing deep traversal by using a start node, wherein the start node is only a service node, so that a corresponding service is created according to the type of the service, http _ server dynamically creates an http service through netty, webservice _ server dynamically generates an interface through javascript first, then creates a webservice through apache cxf based on the dynamically generated interface, and other services call corresponding components to create corresponding services in the same way;
s8, traversing the nodes connected with the previous node, if the current node is a service node, because the platform interface can only be one, other service nodes can only be external interface nodes, http _ client can create http request through the netty, webservice _ client can create webservice client through cxf, and other servers can call corresponding components to create corresponding calls
S9, if the traversed current node is a data processing node, creating a corresponding data processor according to the type of data processing, if json ToMap is used, json is converted through jackson, and other data processing is similar;
s10, if the traversed current node is a data conversion node, traversing according to the source data format and the target data format mapping configured by the user and each field of the source data, if the field is configured with an expression, analyzing according to the expression to obtain a corresponding value as a value of a target field corresponding to the source field, if the field is configured with a conditional expression, performing condition judgment first, and if the condition is not satisfied, skipping the field;
s11, according to the data route definition, each service node, data processing node and data conversion node created by the corresponding node are connected in series according to the arrangement sequence;
s12, in the process of the runtime data receiving the data through the service node for circulation, the output of the previous node will be used as the input parameter of the next node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110413134.6A CN112948152B (en) | 2021-04-16 | 2021-04-16 | Method for processing layout data and calling interface service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110413134.6A CN112948152B (en) | 2021-04-16 | 2021-04-16 | Method for processing layout data and calling interface service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112948152A true CN112948152A (en) | 2021-06-11 |
| CN112948152B CN112948152B (en) | 2022-10-18 |
Family
ID=76232865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110413134.6A Active CN112948152B (en) | 2021-04-16 | 2021-04-16 | Method for processing layout data and calling interface service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112948152B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115951882A (en) * | 2023-02-16 | 2023-04-11 | 中孚安全技术有限公司 | Third-party interface format conversion platform and method based on vue |
| TWI814227B (en) * | 2022-01-27 | 2023-09-01 | 國立高雄師範大學 | Mehod for implementing library by using microservices architecture |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930370A (en) * | 2010-09-09 | 2010-12-29 | 上海普元信息技术股份有限公司 | System structure for realizing data conversion in service integration of SOA (Service Oriented Architecture) application system and method thereof |
| CN102034151A (en) * | 2010-12-13 | 2011-04-27 | 东莞市高鑫机电科技服务有限公司 | SOA-based enterprise collaboration management system service flow design method and system |
| CN103870274A (en) * | 2014-03-14 | 2014-06-18 | 浪潮集团山东通用软件有限公司 | Visual development assembly for realizing data interaction between heterogeneous systems based on web service technology |
| CN105700888A (en) * | 2016-01-14 | 2016-06-22 | 国网山东省电力公司物资公司 | Visualization rapid developing platform based on jbpm workflow engine |
| CN106846226A (en) * | 2017-01-19 | 2017-06-13 | 湖北省基础地理信息中心（湖北省北斗卫星导航应用技术研究院） | A kind of space time information assembling management system |
| CN106961453A (en) * | 2016-01-08 | 2017-07-18 | 中兴通讯股份有限公司 | Service calling method and device based on TOSCA |
| CN109246157A (en) * | 2018-11-16 | 2019-01-18 | 杭州安恒信息技术股份有限公司 | A kind of HTTP requests at a slow speed the association detection method of dos attack |
| CN110213369A (en) * | 2019-06-03 | 2019-09-06 | 电子科技大学 | A kind of service function chain autopatch system and its method of combination |
| CN111245916A (en) * | 2020-01-07 | 2020-06-05 | 苏宁云计算有限公司 | Service calling method, service arranging method and device based on micro-service gateway |
| CN111447170A (en) * | 2019-01-17 | 2020-07-24 | 北京京东尚科信息技术有限公司 | Data processing method and system, computer system and computer readable medium |
| CN111694888A (en) * | 2020-06-12 | 2020-09-22 | 谷云科技(广州)有限责任公司 | Distributed ETL data exchange system and method based on micro-service architecture |
| CN111949257A (en) * | 2020-07-07 | 2020-11-17 | 北京思特奇信息技术股份有限公司 | Towable service arranging method, system and using method |
| CN111984371A (en) * | 2020-08-18 | 2020-11-24 | 济南浪潮高新科技投资发展有限公司 | Flow arrangement service scheduling and publishing method |
-
2021
- 2021-04-16 CN CN202110413134.6A patent/CN112948152B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930370A (en) * | 2010-09-09 | 2010-12-29 | 上海普元信息技术股份有限公司 | System structure for realizing data conversion in service integration of SOA (Service Oriented Architecture) application system and method thereof |
| CN102034151A (en) * | 2010-12-13 | 2011-04-27 | 东莞市高鑫机电科技服务有限公司 | SOA-based enterprise collaboration management system service flow design method and system |
| CN103870274A (en) * | 2014-03-14 | 2014-06-18 | 浪潮集团山东通用软件有限公司 | Visual development assembly for realizing data interaction between heterogeneous systems based on web service technology |
| CN106961453A (en) * | 2016-01-08 | 2017-07-18 | 中兴通讯股份有限公司 | Service calling method and device based on TOSCA |
| CN105700888A (en) * | 2016-01-14 | 2016-06-22 | 国网山东省电力公司物资公司 | Visualization rapid developing platform based on jbpm workflow engine |
| CN106846226A (en) * | 2017-01-19 | 2017-06-13 | 湖北省基础地理信息中心（湖北省北斗卫星导航应用技术研究院） | A kind of space time information assembling management system |
| CN109246157A (en) * | 2018-11-16 | 2019-01-18 | 杭州安恒信息技术股份有限公司 | A kind of HTTP requests at a slow speed the association detection method of dos attack |
| CN111447170A (en) * | 2019-01-17 | 2020-07-24 | 北京京东尚科信息技术有限公司 | Data processing method and system, computer system and computer readable medium |
| CN110213369A (en) * | 2019-06-03 | 2019-09-06 | 电子科技大学 | A kind of service function chain autopatch system and its method of combination |
| CN111245916A (en) * | 2020-01-07 | 2020-06-05 | 苏宁云计算有限公司 | Service calling method, service arranging method and device based on micro-service gateway |
| CN111694888A (en) * | 2020-06-12 | 2020-09-22 | 谷云科技(广州)有限责任公司 | Distributed ETL data exchange system and method based on micro-service architecture |
| CN111949257A (en) * | 2020-07-07 | 2020-11-17 | 北京思特奇信息技术股份有限公司 | Towable service arranging method, system and using method |
| CN111984371A (en) * | 2020-08-18 | 2020-11-24 | 济南浪潮高新科技投资发展有限公司 | Flow arrangement service scheduling and publishing method |
Non-Patent Citations (2)
| Title |
|---|
| 杨海军: ""基于SOA的ERP系统架构分析与应用"", 《中国优秀硕士学位论文全文数据库 (信息科技辑)》 * |
| 阿里云: ""服务编排"", 《HTTPS://HELP.ALIYUN.COM/DOCUMENT_DETAIL/128406.HTML?UTM_CONTENT=G_1000230851&SPM=5176.20966629.TOUBU.3.F2991DDCPXXVD1#SECTION-9YY-QU6-IOG》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI814227B (en) * | 2022-01-27 | 2023-09-01 | 國立高雄師範大學 | Mehod for implementing library by using microservices architecture |
| CN115951882A (en) * | 2023-02-16 | 2023-04-11 | 中孚安全技术有限公司 | Third-party interface format conversion platform and method based on vue |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112948152B (en) | 2022-10-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102015071B1 (en) | Data structure pooling of voice active data packets | |
| US10031922B2 (en) | Systems and methods for query evaluation over distributed linked data stores | |
| CN102325191B (en) | Fully automatic treatment method and frame without page refresh | |
| CN112948152B (en) | Method for processing layout data and calling interface service | |
| CN102185901A (en) | Client message conversion method | |
| US20130159062A1 (en) | Process-driven composite application architecture | |
| JP2021103583A (en) | Method for acquiring target data, device for acquiring target data, electronic apparatus, non-transitory computer readable storage medium, and computer program | |
| US20120054335A1 (en) | Methods and systems for managing quality of services for network participants in a networked business process | |
| CN108874757B (en) | Report generation method and system, computer readable medium and electronic equipment | |
| JP2011118879A (en) | Location independent execution of user interface operations | |
| JP5677319B2 (en) | Web-based diagram visual extensibility | |
| CN111367681B (en) | Bridge design system oriented to cloud computing cluster under high load state | |
| CN114117190A (en) | Data processing method, data processing device, storage medium and electronic equipment | |
| US11943177B2 (en) | Virtual agent portal integration of two frameworks | |
| US20150365460A1 (en) | Dynamic workflow-based composite web service system and method | |
| JP7081014B2 (en) | Methods and devices for adjusting the number of instances, electronic devices, storage media and computer programs | |
| CN109814916B (en) | IVR flow configuration method, device, storage medium and server | |
| CN113923250B (en) | Method, device and system for assisting network service arrangement | |
| CN112559808B (en) | Data processing method and device and electronic equipment | |
| US11188548B2 (en) | Profile data store automation via bots | |
| CN111399806B (en) | Component management method and device, electronic equipment and storage medium | |
| US9338248B2 (en) | Parameter driven value conversion framework in client/server architectures | |
| CN113515285A (en) | Method and device for generating real-time calculation logic data | |
| CN112527290A (en) | Method and device for building page based on biological characteristic information | |
| CN114844957B (en) | Link message conversion method, device, equipment, storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |