CN111666163B - Network arrangement system and method - Google Patents
Network arrangement system and method Download PDFInfo
- Publication number
- CN111666163B CN111666163B CN202010414382.8A CN202010414382A CN111666163B CN 111666163 B CN111666163 B CN 111666163B CN 202010414382 A CN202010414382 A CN 202010414382A CN 111666163 B CN111666163 B CN 111666163B
- Authority
- CN
- China
- Prior art keywords
- pipeline
- processing
- request
- network
- network orchestration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/544—Buffers; Shared memory; Pipes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
- Devices For Executing Special Programs (AREA)
Abstract
The embodiment of the invention provides a network arrangement system and a network arrangement method, wherein the system comprises a pipeline manager, a functional module and a pipeline, wherein: the pipeline manager is used for managing single instances of the life cycle and the state of the internal instances of the whole network arrangement system; the function module is used for processing a request processing program for requesting configuration and processing response states and data; the pipeline is a queue containing stages for processing request handlers in first-out and for processing response handlers in last-in first-out. The embodiment of the invention can unify the problem of the network layer of the front end, reuse most of processing programs, and a developer can form a plurality of predictable pipelines according to stages in a plurality of projects, thereby remarkably reducing development difficulty and keeping cost.
Description
Technical Field
The present invention relates to the field of network processing technologies, and in particular, to a network arrangement system and method.
Background
In current application development, network requests are high frequency and complex. When a Web client attempts to communicate with a server, network errors, session timeouts, incorrect published data structures, and business errors may be encountered. In complex systems, developers need to expend too much effort to handle responses and errors, and most of the processing functions are repetitive, such as session timeouts, common business error codes. Moreover, if response logic such as error handling or data structures should be altered, the developer must modify all relevant functions and the network behavior of the individual functional modules throughout the system is unpredictable.
Most client programming models are Model-View-controller (MVC) or Model-View-ViewModel (MVVM). There are no network-related layers in the current programming Model, and most request and response handlers are written in the Controller/ViewModel or Model layer, which is difficult to maintain. As more and more Web applications run on mobile devices, networks become more complex. Thus, there is a need for an agile system level network solution that reduces development effort and makes the network-side application state predictable.
Accordingly, there is a need for a network orchestration system and method that solves the above-mentioned problems.
Disclosure of Invention
Aiming at the problems existing in the prior art, the embodiment of the invention provides a network arrangement system and a network arrangement method.
In a first aspect, an embodiment of the present invention provides a network orchestration system, including a pipeline manager, a functional module, and a pipeline, where:
the pipeline manager is used for managing single instances of the life cycle and the state of the internal instances of the whole network arrangement system;
the function module is used for processing a request processing program for requesting configuration and processing response states and data;
the pipeline is a queue containing stages for processing request handlers in first-out and for processing response handlers in last-in first-out.
Further, the network orchestration system also comprises a functional module warehouse for retrieving arbitrary codes for storage.
Further, the pipeline manager is further configured to create a request instance in the target page and the function.
Further, the pipeline manager is further configured to register a multi-level global pipeline layer, where the multi-level global pipeline layer is configured according to a preset application scenario condition.
Further, the functional module is also used for processing tasks related to the data.
In a second aspect, an embodiment of the present invention provides a network orchestration method, including:
creating pipelines corresponding to different application scenes, wherein the pipelines are queues containing stages;
the pipes are combined in a project such that in one stage the pipes deal only with simple cases.
Further, after said combining the pipes in the project, the method further comprises: the stage at which the pipe is in is detected when processing a request or response to alter the request data and header at the pipe.
Further, after said combining the pipes in the project, the method further comprises: the handler does not respond and the application is reused.
In a third aspect, an embodiment of the invention provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method as provided in the first aspect when the program is executed.
In a fourth aspect, embodiments of the present invention provide a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method as provided by the first aspect.
The network arrangement system and the network arrangement method provided by the embodiment of the invention can unify the network layer problem of the front end, reuse most of processing programs, enable developers to form a plurality of predictable pipelines in a plurality of projects according to stages, obviously reduce development difficulty and keep cost.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a network arrangement system according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a network pipeline architecture according to an embodiment of the present invention;
fig. 3 is a flow chart of a network arrangement method according to an embodiment of the present invention;
FIG. 4 is a schematic project diagram of network orchestration provided by an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Fig. 1 is a schematic structural diagram of a network orchestration system according to an embodiment of the present invention, and as shown in fig. 1, the embodiment of the present invention provides a network orchestration system, which includes a pipeline manager 101, a functional module 102, and a pipeline 103, where:
the pipeline manager 101 is used for managing single instances of the life cycle and the state of the internal instances of the whole network orchestration system;
the functional module 102 is configured to process a request processing program for requesting configuration and process a response state and data;
the pipeline 103 is a queue containing stages for processing request handlers in a first-in first-out process and for processing response handlers in a last-in first-out process.
Fig. 2 is a schematic diagram of a network pipeline architecture provided in an embodiment of the present invention, as shown in fig. 2, in order to solve the problems in the prior art, the embodiment of the present invention introduces a combinable, reusable, and predictable network pipeline architecture, which unifies network processing programs in a pipeline layer, and may refer to fig. 1 and fig. 2, and includes four parts, namely a pipeline manager 101, a function module 102, a pipeline 103, and a function module warehouse.
The pipeline manager 101 is used to manage single instance instances of the entire internal instance lifecycle and state. The function module 102 is a special network function handler module having two important functions, one is a request handler for handling request configuration, such as a request header or a merge batch request; the other is a response handler for handling response status and data, e.g. error handling or server response data format. Pipeline 103 is a queue containing stages, with execution rules that request that the handler follow a first-in-first-out (FIFO) and response handler follow a last-in-first-out (LIFO). It should be noted that, in the embodiment of the present invention, the high-level pipeline always executes first, then passes the request instance to the next high-level pipeline, and finally processes the response again. The function module warehouse is a collection of easily recoverable stages that developers can push code to the repository and use it anywhere.
The network arrangement system provided by the embodiment of the invention can unify the network layer problem of the front end, reuse most of processing programs, enable developers to form a plurality of predictable pipelines in a plurality of projects according to stages, remarkably reduce development difficulty and keep cost.
On the basis of the above embodiment, the pipeline manager 101 is further configured to create a request instance in a target page and a function.
On the basis of the above embodiment, the pipe manager 101 is further configured to register a multi-level global pipe layer, where the multi-level global pipe layer is configured according to a preset application scenario condition.
In an embodiment of the invention, the pipeline manager 101 may create a request instance to be used in a target page or function, and it may register multiple levels of global pipeline layers, and may also configure the pipeline stage store to dynamically require stages from the store.
On the basis of the above embodiment, the functional module 102 is further configured to process tasks related to data.
In an embodiment of the invention, the functional module 102 may remain in a repository folder and be reusable. The functional module 102 is very flexible in that it can handle most data-related tasks and can run in the main UI thread or create new threads using Web workbench to handle complex computational tasks, e.g., formatting html dom nodes from a single row string of servers, processing reporting data.
Fig. 3 is a flow chart of a network arrangement method according to an embodiment of the present invention, and as shown in fig. 3, an embodiment of the present invention provides a network arrangement method, including:
In embodiments of the invention, a developer may create different pipelines for different scenarios and combine them in one or other projects. In one stage, the pipeline handles only simple situations, and is easy to reuse and debug.
Fig. 4 is a schematic network arrangement project diagram provided by an embodiment of the present invention, as shown in fig. 4, in which in the embodiment of the present invention, there are 3 network layers: a page/control layer, an application layer and an infrastructure layer.
In particular, the application layer and the infrastructure layer are global level pipelines that a developer can configure, and thus, in daily page development, do not need to deal with these network situations. The page/control layer is the highest layer that creates the request instance using the pipeline manager.
In the embodiment of the invention, the current page has 2 stages in the page range pipeline, and the page level data verification stage is a stage for verifying special page data which should be sent to the server, and if the special page data is incorrect, a page display error can be notified because the special page data is the stage of the page range pipeline; the "batch request phase" is used to dynamically merge all current page requests, e.g., a page has multiple tiles, and each tile must send a request to update data in a different period of time, which makes it difficult for a developer to issue a request in batches, because only one request is sent in the tile range, while too many tiles are displayed together in the page range and the data needs to be updated, which requests should be merged for performance reasons. Further, in embodiments of the present invention, the "batch request phase" is reached only if the request is sent through the page level, where each request can be retained and merged into one request until the time out or the maximum request array length is exceeded, and then this new request is sent, where when the response is returned, the phase will split the data for each original request instance.
In the application layer, events at the application level are handled, e.g., 401 unauthorized, offline, etc. In the embodiment of the invention, when the user clicks the get order list button but the session times out, the server will respond to the client error code 401, typically the user redirects to the login page to re-login and then get the data again, but in the embodiment of the invention, the re-login page may be popped up in the "401 unauthorized stage" response handler, and the response is retained, without letting the response enter the next stage, when the user login is successful, the request will be automatically resent, the user experience will be better and then the get order list button will be clicked again. If the application supports an offline solution that does not involve the infrastructure layer, the developer can process a response in the "offline solution phase" that does not make a real request to the server.
The network arrangement method provided by the embodiment of the invention can unify the network layer problem of the front end, reuse most of processing programs, enable developers to form a plurality of predictable pipelines in a plurality of projects according to stages, remarkably reduce development difficulty and keep cost.
On the basis of the above embodiment, after the combining of the pipes in the project, the method further includes: the stage at which the pipe is in is detected when processing a request or response to alter the request data and header at the pipe.
In the embodiment of the invention, whether the pipeline is in the page range pipeline stage or the batch processing request stage can be detected, and then different pipeline response processes are carried out according to the pipeline stages.
On the basis of the above embodiment, after the combining of the pipes in the project, the method further includes: when the handler does not respond, the application is reused.
In the embodiment of the invention, when the processing program does not respond, the processing program can be reused for most of the processing programs.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and referring to fig. 5, the electronic device may include: a processor (processor) 501, a communication interface (Communications Interface) 502, a memory (memory) 503 and a communication bus 504, wherein the processor 501, the communication interface 502, and the memory 503 communicate with each other via the communication bus 504. The processor 501 may call logic instructions in the memory 503 to perform the following method: creating pipelines corresponding to different application scenes, wherein the pipelines are queues containing stages; the pipes are combined in a project such that in one stage the pipes deal only with simple cases.
Further, the logic instructions in the memory 503 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, embodiments of the present invention further provide a non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor is implemented to perform the network orchestration method provided by the above embodiments, for example comprising: creating pipelines corresponding to different application scenes, wherein the pipelines are queues containing stages; the pipes are combined in a project such that in one stage the pipes deal only with simple cases.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (8)
1. A network orchestration system comprising a pipeline manager, functional modules, and pipelines, wherein:
the pipeline manager is used for managing single instances of the life cycle and the state of the internal instances of the whole network arrangement system;
the function module is used for processing a request processing program for requesting configuration and processing response states and data;
the pipeline is a queue containing stages and is used for processing a request processing program according to first-in first-out processing and processing a response processing program according to last-in first-out processing;
the pipeline manager is further used for registering a multi-stage global pipeline layer, wherein the multi-stage global pipeline layer is configured according to preset application scene conditions.
2. The network orchestration system according to claim 1, further comprising a repository of functional modules for reclaiming any codes for storage.
3. The network orchestration system according to claim 1, wherein the pipeline manager is further configured to create a request instance in a target page and function.
4. The network orchestration system according to claim 1, wherein the functional modules are further configured to process tasks related to data.
5. A method of network orchestration, comprising:
creating pipelines corresponding to different application scenes, wherein the pipelines are queues containing stages;
combining the pipes in a project such that in one stage the pipes deal only with simple cases;
after said combining the pipes in the project, the method further comprises: the pipeline is detected at the stage of processing the request or response, so that the request data and the header are changed at the pipeline, and different pipeline response processing is performed according to the different stages.
6. The network orchestration method according to claim 5, wherein after the combining the pipes in an item, the method further comprises: the handler does not respond and the application is reused.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the network orchestration method according to any one of claims 5-6 when the program is executed.
8. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor performs the steps of the network orchestration method according to any one of claims 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010414382.8A CN111666163B (en) | 2020-05-15 | 2020-05-15 | Network arrangement system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010414382.8A CN111666163B (en) | 2020-05-15 | 2020-05-15 | Network arrangement system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111666163A CN111666163A (en) | 2020-09-15 |
| CN111666163B true CN111666163B (en) | 2023-07-11 |
Family
ID=72383724
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010414382.8A Active CN111666163B (en) | 2020-05-15 | 2020-05-15 | Network arrangement system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111666163B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110120963A (en) * | 2018-02-06 | 2019-08-13 | 阿里巴巴集团控股有限公司 | A kind of data processing method, device, equipment and machine readable media |
| CN110704209A (en) * | 2019-09-20 | 2020-01-17 | 江苏未来智慧信息科技有限公司 | Data mining analysis platform based on PIPE communication |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012078157A1 (en) * | 2010-12-09 | 2012-06-14 | Intel Corporation | Method and apparatus for managing application state in a network interface controller in a high performance computing system |
| US10296327B2 (en) * | 2016-10-15 | 2019-05-21 | Vmware, Inc. | Methods and systems that share resources among multiple, interdependent release pipelines |
| US10476912B2 (en) * | 2017-09-18 | 2019-11-12 | Veracity Security Intelligence, Inc. | Creating, visualizing, and simulating a threat based whitelisting security policy and security zones for networks |
-
2020
- 2020-05-15 CN CN202010414382.8A patent/CN111666163B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110120963A (en) * | 2018-02-06 | 2019-08-13 | 阿里巴巴集团控股有限公司 | A kind of data processing method, device, equipment and machine readable media |
| CN110704209A (en) * | 2019-09-20 | 2020-01-17 | 江苏未来智慧信息科技有限公司 | Data mining analysis platform based on PIPE communication |
Non-Patent Citations (1)
| Title |
|---|
| 程杰.云计算网络的自动化编排.《2015 电力行业信息化年会论文集》.2015,352-356. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111666163A (en) | 2020-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109951547B (en) | Transaction request parallel processing method, device, equipment and medium | |
| US10871918B2 (en) | Writing composite objects to a data store | |
| EP3021217A1 (en) | Distributed analysis and attribution of source code | |
| US20150199415A1 (en) | Parallel transaction messages for database replication | |
| US20170255886A1 (en) | Workflow execution | |
| KR20150038758A (en) | Managing task execution | |
| CN108733496B (en) | Event processing method and device | |
| US11907296B2 (en) | Method and system for traversing an object graph using traversal context objects | |
| CN111026430A (en) | Method and system for flexible node composition on local or distributed computer system | |
| US11113176B2 (en) | Generating a debugging network for a synchronous digital circuit during compilation of program source code | |
| US20190073249A1 (en) | Message oriented middleware with integrated rules engine | |
| US20120137298A1 (en) | Managing Groups of Computing Entities | |
| CN111522651B (en) | Managing metadata for a distributed processing system | |
| US8407713B2 (en) | Infrastructure of data summarization including light programs and helper steps | |
| US11848983B2 (en) | Remotely discover and map a network resource model in a cloud environment | |
| US11068487B2 (en) | Event-stream searching using compiled rule patterns | |
| US20200174804A1 (en) | Graphical User Interface Command Pattern | |
| CN111555987B (en) | Current limiting configuration method, device, equipment and computer storage medium | |
| CN111666163B (en) | Network arrangement system and method | |
| US10621163B2 (en) | Tracking and reusing function results | |
| US9059992B2 (en) | Distributed mobile enterprise application platform | |
| CN109150993B (en) | Method for obtaining network request tangent plane, terminal device and storage medium | |
| CN113805858A (en) | Method and device for continuously deploying software developed by scripting language | |
| US20080163224A1 (en) | Modeling interrupts in a business process | |
| US10990887B1 (en) | Anything-but matching using finite-state machines |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |