CN112328307A - Development, operation and maintenance integrated system - Google Patents
Development, operation and maintenance integrated system Download PDFInfo
- Publication number
- CN112328307A CN112328307A CN202011243753.7A CN202011243753A CN112328307A CN 112328307 A CN112328307 A CN 112328307A CN 202011243753 A CN202011243753 A CN 202011243753A CN 112328307 A CN112328307 A CN 112328307A
- Authority
- CN
- China
- Prior art keywords
- development
- module
- pipeline
- maintenance
- code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000011161 development Methods 0.000 title claims abstract description 66
- 238000012423 maintenance Methods 0.000 title claims abstract description 44
- 238000003860 storage Methods 0.000 claims abstract description 22
- 238000012544 monitoring process Methods 0.000 claims abstract description 12
- 238000000034 method Methods 0.000 claims description 22
- 238000010276 construction Methods 0.000 claims description 10
- 230000008569 process Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 230000010354 integration Effects 0.000 claims description 7
- 238000012360 testing method Methods 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011981 development test Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline or look ahead
- G06F9/3867—Concurrent instruction execution, e.g. pipeline or look ahead using instruction pipelines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a development, operation and maintenance integrated system, which comprises a development service module, a pipeline scheduling module, a working node module and an operation monitoring module, wherein the development service module is used for code editing, code storage and code dependence management; the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition; the working node module is used for providing bottom layer operation resources for the pipeline scheduling module; the operation monitoring module is used for collecting the operation condition of each environment in real time and feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, so that the resource utilization rate, the product release efficiency and the system stability are improved, and a friendly development environment and good experience are provided for developers.
Description
Technical Field
The invention relates to the field of software engineering, in particular to a development, operation and maintenance integrated system.
Background
With the continuous development of internet technology, various software services have become indispensable tools in life and work. A complete network service is often composed of a plurality of micro service systems, and the plurality of micro service systems are interdependent, each time the release and iteration of the system involves the mutual coordination and cooperation among the plurality of micro service systems, the traditional software development and deployment system has the following defects when facing the simultaneous deployment and upgrade of the plurality of systems:
(1) the process is complex, multiple manual interventions are needed, and the manual interventions cause the system to be prone to errors;
(2) the resource utilization rate of the development operation and maintenance system is low, and the resource utilization rate of the system cannot be improved;
(3) the visualization is poor, and the current system release state is often checked through a log;
(4) the system cannot support multiple environments, such as development environment and production environment, and multiple development operation and maintenance systems are required to be built, so that the system is built repeatedly, and operation and maintenance resources are wasted;
(5) the fault tolerance is poor, and if an environment in the development operation and maintenance system makes a mistake, the whole development operation and maintenance process fails.
Disclosure of Invention
In order to overcome the defects in the prior art, an embodiment of the present invention provides a development, operation and maintenance integrated system, which includes a development service module, a pipeline scheduling module, a work node module, and an operation monitoring module, wherein:
the development service module is used for code editing, code storage and code dependence management;
the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition;
the working node module is used for providing bottom layer running resources for the pipeline scheduling module, wherein the bottom layer running resources are dynamically distributed according to the pipeline scheduling condition, and are uniformly recycled by the pipeline scheduling module after being distributed, so that the next scheduling is prepared;
the operation monitoring module is used for acquiring the operation condition of each environment in real time, feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, and providing operation data support for the development assembly line and the operation and maintenance assembly line scheduling.
Preferably, the pipeline scheduling module is further configured to receive a code construction request sent by a user, determine whether current remaining resources of each node meet a current pipeline resource quota, and if so, create a new service scheduling task.
Preferably, the worker node module is further configured to receive the constructed code and generate one or more copies of the code instances according to user configuration.
Preferably, the bottom layer operating resources include a computing resource pool, a storage resource pool, and a network resource pool.
Preferably, the work node module is a resource pool cluster.
The development, operation and maintenance integrated system provided by the embodiment of the invention has the following beneficial effects:
(1) the developer does not need to install a development and debugging environment, a code editing and debugging environment is completely provided at a development, operation and maintenance server, and the running state and the result of the program are stored at the server, so that a friendly development environment and good experience are provided for the developer;
(2) the method has the advantages that flexible pipeline operation is realized, a user can simply edit the pipeline through an interface, complex pipeline operation can be realized through coding, and the operation from the development stage to the operation and maintenance stage to the whole-flow pipeline editing operation is realized;
(3) efficient resource utilization efficiency, traditional development, operation and maintenance integration system need special work node to be responsible for the assembly line and releases, and assembly line work node and application work node merge together in this patent, and after the assembly line was released, resource recovery had improved the resource usage rate.
(4) The system can support various development languages, and currently supports various languages such as java, golang, javascript and the like;
(5) the system supports multi-environment configuration, can be independently or simultaneously released to a plurality of development test environments, and can release products to a development environment, an integration environment, a test environment and a production environment according to the selection of a user, so that the release efficiency of the products is improved;
(6) in order to prevent network attack and improve the stability of the system, the development, operation and maintenance integrated system can be installed and deployed in a whole offline mode, code development, release and full-process support are completed in an offline network environment, and software can be upgraded and deployed without networking;
(7) the cluster support is adopted, the development service cluster, the assembly line scheduling module, the working node module and the operation monitoring module in the development, operation and maintenance integrated system are all in cluster deployment, single-node faults do not affect the overall operation, meanwhile, the system can dynamically increase nodes along with the increase of loads, and the stability of the system is improved.
Drawings
Fig. 1 is a schematic structural diagram of a development, operation and maintenance integrated system provided in an embodiment of the present invention.
Detailed Description
The invention is described in detail below with reference to the following figures and examples.
As shown in fig. 1, the development, operation and maintenance integrated system provided in the embodiment of the present invention includes a development service module, a pipeline scheduling module, a work node module, and an operation monitoring module, where:
the development service module is used for code editing, code storage and code dependence management.
The assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition.
And the working node module is used for providing bottom layer operation resources for the pipeline scheduling module, wherein the bottom layer operation resources are dynamically distributed according to the pipeline scheduling condition, and are uniformly recovered by the pipeline scheduling module after the distribution is finished so as to prepare for the next scheduling.
Generally, a company has many projects, each project may use a development operation and maintenance pipeline to compile the project at any moment, and if too many projects are compiled at the same time, the project compilation may be blocked, and the project development efficiency may be affected.
The pipeline scheduling module can allocate different pipeline resources to compile the project module according to the project property and the past pipeline historical records and the setting of a user. A plurality of pipelines can be developed in parallel, compiling efficiency is improved, compiling nodes are limited on limited nodes, and normal running services are prevented from being affected due to the fact that the pipelines use resources excessively.
For example, if the project a uses the P1 pipeline to compile and deploy the project, the pipeline task is executed according to the cluster-removing initialization pipeline information set by the user when the pipeline is run for the first time. After the execution is successful, the related execution information can be stored, and the resources used by the pipeline can be preferentially used in the next execution, so that the compiling efficiency is improved.
Meanwhile, the project B can use a P2 pipeline to compile and deploy projects, if the pipeline resources are enough, the P1 pipeline and the P2 pipeline can be executed simultaneously in parallel, and if the pipeline resources are insufficient, the pipelines are put into a queuing waiting queue in time sequence until the resources are released to meet the queued pipeline operation.
The operation monitoring module is used for acquiring the operation condition of each environment in real time, feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, and providing operation data support for the development assembly line and the operation and maintenance assembly line scheduling.
Wherein each environment includes a development environment, an integrated test environment, a quasi-production environment, and a production environment.
Optionally, the pipeline scheduling module is further configured to receive a code construction request sent by a user, determine whether the current remaining resources of each node meet the current pipeline resource quota, and if so, create a new service scheduling task.
The operation monitoring module collects resource information of each node from a current cluster at regular time, such as CPU, internal memory, disk and network occupation conditions, each pipeline is provided with resource quota configuration, after a user triggers the pipeline to start, the cluster detects each current node, if resources of a node meet the pipeline quota, pipeline changing operation is executed at the node, if no resource of the node in the cluster meets the pipeline resource quota, the pipeline enters a queuing waiting state until the node meets the condition, and the pipeline is executed.
Optionally, the work node module is further configured to receive the constructed code and generate one or more example copies of the code according to user configuration.
Optionally, the bottom-layer operating resource includes a computing resource pool, a storage resource pool, and a network resource pool.
Optionally, the work node module is a resource pool cluster.
The operation flow of the development, operation and maintenance integrated system provided by the embodiment of the invention is as follows:
a user logs in a development service module at a terminal, can edit codes with authority of the user on line after logging in, clicks and stores the codes after the codes are edited, and simultaneously can select whether to trigger code construction and a code release environment, if the code construction and the code release environment are selected, construction information is handed to a pipeline scheduling cluster;
after receiving a user construction request, the pipeline scheduling module checks the current system resource, and if the resource is enough, a pipeline scheduling task is newly established, wherein the task can be divided into the following stages: the method comprises a code construction and compiling stage, an engineering verification stage, an engineering release stage and an engineering deployment stage. Wherein:
the code building and compiling stage downloads code from a code repository, downloads dependency packages from a dependency repository, and then performs code compilation. Outputting an executable building package;
in the engineering verification stage, according to user configuration, multi-aspect tests such as unit test, integration test and the like are carried out on the executable building package;
in the engineering release stage, the tested construction package is set with version information and is released into a warehouse, and the construction package can be divided into a containerized mirror image package and a bare metal server operation package;
in the engineering deployment stage, the constructed application package is deployed to a working node cluster according to user configuration;
and after receiving the deployment request, the working node module generates one or more application example copies according to user configuration, so as to realize high-availability deployment of the application.
The development, operation and maintenance integrated system provided by the embodiment of the invention comprises a development service module, a pipeline scheduling module, a working node module and an operation monitoring module, wherein the development service module is used for code editing, code storage and code dependence management; the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition; the working node module is used for providing bottom layer operation resources for the pipeline scheduling module; the operation monitoring module is used for collecting the operation condition of each environment in real time and feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, so that the resource utilization rate, the product release efficiency and the system stability are improved, and a friendly development environment and good experience are provided for developers.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be appreciated that the relevant features of the method and apparatus described above are referred to one another.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In addition, the memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011243753.7A CN112328307A (en) | 2020-11-10 | 2020-11-10 | Development, operation and maintenance integrated system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011243753.7A CN112328307A (en) | 2020-11-10 | 2020-11-10 | Development, operation and maintenance integrated system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112328307A true CN112328307A (en) | 2021-02-05 |
Family
ID=74317201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011243753.7A Pending CN112328307A (en) | 2020-11-10 | 2020-11-10 | Development, operation and maintenance integrated system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112328307A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113127368A (en) * | 2021-04-30 | 2021-07-16 | 中原银行股份有限公司 | Method, system and medium for generating assembly line |
| CN113641402A (en) * | 2021-08-30 | 2021-11-12 | 北京读我科技有限公司 | Method and device for realizing task arrangement and operation |
| CN114860406A (en) * | 2022-05-18 | 2022-08-05 | 南京安元科技有限公司 | Distributed compiling and packaging system and method based on Docker |
| CN114942746A (en) * | 2022-03-29 | 2022-08-26 | 中国人寿保险股份有限公司 | Application building and publishing platform and method |
| CN116521363A (en) * | 2023-04-06 | 2023-08-01 | 中保车服科技服务股份有限公司 | Code packaging method, computer equipment and storage medium |
| CN116560658A (en) * | 2023-06-29 | 2023-08-08 | 睿思芯科(深圳)技术有限公司 | Cloud technology-based chip integrated development system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095482A (en) * | 2011-11-07 | 2013-05-08 | 上海宝信软件股份有限公司 | Program development maintenance system |
| CN106708509A (en) * | 2016-11-28 | 2017-05-24 | 上海宝尊电子商务有限公司 | Automatic software project development all-link configuration management system |
| US20180300847A1 (en) * | 2017-04-17 | 2018-10-18 | Intel Corporation | Adaptive compute size per workload |
| CN110069335A (en) * | 2019-05-07 | 2019-07-30 | 江苏满运软件科技有限公司 | Task processing system, method, computer equipment and storage medium |
-
2020
- 2020-11-10 CN CN202011243753.7A patent/CN112328307A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095482A (en) * | 2011-11-07 | 2013-05-08 | 上海宝信软件股份有限公司 | Program development maintenance system |
| CN106708509A (en) * | 2016-11-28 | 2017-05-24 | 上海宝尊电子商务有限公司 | Automatic software project development all-link configuration management system |
| US20180300847A1 (en) * | 2017-04-17 | 2018-10-18 | Intel Corporation | Adaptive compute size per workload |
| CN110069335A (en) * | 2019-05-07 | 2019-07-30 | 江苏满运软件科技有限公司 | Task processing system, method, computer equipment and storage medium |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113127368A (en) * | 2021-04-30 | 2021-07-16 | 中原银行股份有限公司 | Method, system and medium for generating assembly line |
| CN113641402A (en) * | 2021-08-30 | 2021-11-12 | 北京读我科技有限公司 | Method and device for realizing task arrangement and operation |
| CN113641402B (en) * | 2021-08-30 | 2024-07-12 | 北京读我科技有限公司 | Task arrangement and operation realization method and device |
| CN114942746A (en) * | 2022-03-29 | 2022-08-26 | 中国人寿保险股份有限公司 | Application building and publishing platform and method |
| CN114860406A (en) * | 2022-05-18 | 2022-08-05 | 南京安元科技有限公司 | Distributed compiling and packaging system and method based on Docker |
| CN114860406B (en) * | 2022-05-18 | 2024-02-20 | 安元科技股份有限公司 | A distributed compilation and packaging system and method based on Docker |
| CN116521363A (en) * | 2023-04-06 | 2023-08-01 | 中保车服科技服务股份有限公司 | Code packaging method, computer equipment and storage medium |
| CN116521363B (en) * | 2023-04-06 | 2024-01-30 | 中保车服科技服务股份有限公司 | Code packaging method, computer equipment and storage medium |
| CN116560658A (en) * | 2023-06-29 | 2023-08-08 | 睿思芯科(深圳)技术有限公司 | Cloud technology-based chip integrated development system |
| CN116560658B (en) * | 2023-06-29 | 2024-02-06 | 睿思芯科(深圳)技术有限公司 | Cloud technology-based chip integrated development system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112328307A (en) | Development, operation and maintenance integrated system | |
| Burns et al. | Borg, omega, and kubernetes | |
| US8078704B2 (en) | Provisioning of a service environment using web services | |
| US9002997B2 (en) | Instance host configuration | |
| JP5897816B2 (en) | Dependency graph parameter scoping | |
| RU2429529C2 (en) | Dynamic configuration, allocation and deployment of computer systems | |
| US8893118B2 (en) | Migratable unit based application migration | |
| US20070083588A1 (en) | Systems and methods for automated provisioning of managed computing resources | |
| EP2948865B1 (en) | Instance host configuration | |
| US20170255886A1 (en) | Workflow execution | |
| US11947996B2 (en) | Execution of services concurrently | |
| US8555286B2 (en) | Method, system, and apparatus for establishing a software configurable computing environment | |
| CN107179982B (en) | Cross-process debugging method and device | |
| US11108638B1 (en) | Health monitoring of automatically deployed and managed network pipelines | |
| JP7373587B2 (en) | Service management in DBMS | |
| JP2006107449A (en) | Entity domain | |
| US11675678B1 (en) | Managing storage domains, service tiers, and failed service tiers | |
| CN110019144A (en) | A kind of method and system of big data platform data O&M | |
| CN118444970A (en) | Version management system of application distribution platform | |
| CN116302452B (en) | Job scheduling method, system, device, communication equipment and storage medium | |
| US20060089922A1 (en) | Method, system, and apparatus for allocating resources to a software configurable computing environment | |
| CN116382694A (en) | Method for improving compiling speed of Maven engineering in container environment | |
| Goodwin et al. | What goes wrong in serverless runtimes? A survey of bugs in Knative Serving | |
| US20210373868A1 (en) | Automated Deployment And Management Of Network Intensive Applications | |
| CN113220438B (en) | System for executing operation, method and device for testing batch operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210205 |