CN112328307A - Development, operation and maintenance integrated system - Google Patents

Development, operation and maintenance integrated system Download PDF

Info

Publication number
CN112328307A
CN112328307A CN202011243753.7A CN202011243753A CN112328307A CN 112328307 A CN112328307 A CN 112328307A CN 202011243753 A CN202011243753 A CN 202011243753A CN 112328307 A CN112328307 A CN 112328307A
Authority
CN
China
Prior art keywords
development
module
maintenance
assembly line
code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011243753.7A
Other languages
Chinese (zh)
Inventor
孔祥文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Shenzhou Digital Technology Co ltd
Original Assignee
Beijing Shenzhou Digital Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Shenzhou Digital Technology Co ltd filed Critical Beijing Shenzhou Digital Technology Co ltd
Priority to CN202011243753.7A priority Critical patent/CN112328307A/en
Publication of CN112328307A publication Critical patent/CN112328307A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3867Concurrent instruction execution, e.g. pipeline or look ahead using instruction pipelines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/20Software design

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a development, operation and maintenance integrated system, which comprises a development service module, a pipeline scheduling module, a working node module and an operation monitoring module, wherein the development service module is used for code editing, code storage and code dependence management; the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition; the working node module is used for providing bottom layer operation resources for the pipeline scheduling module; the operation monitoring module is used for collecting the operation condition of each environment in real time and feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, so that the resource utilization rate, the product release efficiency and the system stability are improved, and a friendly development environment and good experience are provided for developers.

Description

Development, operation and maintenance integrated system
Technical Field
The invention relates to the field of software engineering, in particular to a development, operation and maintenance integrated system.
Background
With the continuous development of internet technology, various software services have become indispensable tools in life and work. A complete network service is often composed of a plurality of micro service systems, and the plurality of micro service systems are interdependent, each time the release and iteration of the system involves the mutual coordination and cooperation among the plurality of micro service systems, the traditional software development and deployment system has the following defects when facing the simultaneous deployment and upgrade of the plurality of systems:
(1) the process is complex, multiple manual interventions are needed, and the manual interventions cause the system to be prone to errors;
(2) the resource utilization rate of the development operation and maintenance system is low, and the resource utilization rate of the system cannot be improved;
(3) the visualization is poor, and the current system release state is often checked through a log;
(4) the system cannot support multiple environments, such as development environment and production environment, and multiple development operation and maintenance systems are required to be built, so that the system is built repeatedly, and operation and maintenance resources are wasted;
(5) the fault tolerance is poor, and if an environment in the development operation and maintenance system makes a mistake, the whole development operation and maintenance process fails.
Disclosure of Invention
In order to overcome the defects in the prior art, an embodiment of the present invention provides a development, operation and maintenance integrated system, which includes a development service module, a pipeline scheduling module, a work node module, and an operation monitoring module, wherein:
the development service module is used for code editing, code storage and code dependence management;
the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition;
the working node module is used for providing bottom layer running resources for the pipeline scheduling module, wherein the bottom layer running resources are dynamically distributed according to the pipeline scheduling condition, and are uniformly recycled by the pipeline scheduling module after being distributed, so that the next scheduling is prepared;
the operation monitoring module is used for acquiring the operation condition of each environment in real time, feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, and providing operation data support for the development assembly line and the operation and maintenance assembly line scheduling.
Preferably, the pipeline scheduling module is further configured to receive a code construction request sent by a user, determine whether current remaining resources of each node meet a current pipeline resource quota, and if so, create a new service scheduling task.
Preferably, the worker node module is further configured to receive the constructed code and generate one or more copies of the code instances according to user configuration.
Preferably, the bottom layer operating resources include a computing resource pool, a storage resource pool, and a network resource pool.
Preferably, the work node module is a resource pool cluster.
The development, operation and maintenance integrated system provided by the embodiment of the invention has the following beneficial effects:
(1) the developer does not need to install a development and debugging environment, a code editing and debugging environment is completely provided at a development, operation and maintenance server, and the running state and the result of the program are stored at the server, so that a friendly development environment and good experience are provided for the developer;
(2) the method has the advantages that flexible pipeline operation is realized, a user can simply edit the pipeline through an interface, complex pipeline operation can be realized through coding, and the operation from the development stage to the operation and maintenance stage to the whole-flow pipeline editing operation is realized;
(3) efficient resource utilization efficiency, traditional development, operation and maintenance integration system need special work node to be responsible for the assembly line and releases, and assembly line work node and application work node merge together in this patent, and after the assembly line was released, resource recovery had improved the resource usage rate.
(4) The system can support various development languages, and currently supports various languages such as java, golang, javascript and the like;
(5) the system supports multi-environment configuration, can be independently or simultaneously released to a plurality of development test environments, and can release products to a development environment, an integration environment, a test environment and a production environment according to the selection of a user, so that the release efficiency of the products is improved;
(6) in order to prevent network attack and improve the stability of the system, the development, operation and maintenance integrated system can be installed and deployed in a whole offline mode, code development, release and full-process support are completed in an offline network environment, and software can be upgraded and deployed without networking;
(7) the cluster support is adopted, the development service cluster, the assembly line scheduling module, the working node module and the operation monitoring module in the development, operation and maintenance integrated system are all in cluster deployment, single-node faults do not affect the overall operation, meanwhile, the system can dynamically increase nodes along with the increase of loads, and the stability of the system is improved.
Drawings
Fig. 1 is a schematic structural diagram of a development, operation and maintenance integrated system provided in an embodiment of the present invention.
Detailed Description
The invention is described in detail below with reference to the following figures and examples.
As shown in fig. 1, the development, operation and maintenance integrated system provided in the embodiment of the present invention includes a development service module, a pipeline scheduling module, a work node module, and an operation monitoring module, where:
the development service module is used for code editing, code storage and code dependence management.
The assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition.
And the working node module is used for providing bottom layer operation resources for the pipeline scheduling module, wherein the bottom layer operation resources are dynamically distributed according to the pipeline scheduling condition, and are uniformly recovered by the pipeline scheduling module after the distribution is finished so as to prepare for the next scheduling.
Generally, a company has many projects, each project may use a development operation and maintenance pipeline to compile the project at any moment, and if too many projects are compiled at the same time, the project compilation may be blocked, and the project development efficiency may be affected.
The pipeline scheduling module can allocate different pipeline resources to compile the project module according to the project property and the past pipeline historical records and the setting of a user. A plurality of pipelines can be developed in parallel, compiling efficiency is improved, compiling nodes are limited on limited nodes, and normal running services are prevented from being affected due to the fact that the pipelines use resources excessively.
For example, if the project a uses the P1 pipeline to compile and deploy the project, the pipeline task is executed according to the cluster-removing initialization pipeline information set by the user when the pipeline is run for the first time. After the execution is successful, the related execution information can be stored, and the resources used by the pipeline can be preferentially used in the next execution, so that the compiling efficiency is improved.
Meanwhile, the project B can use a P2 pipeline to compile and deploy projects, if the pipeline resources are enough, the P1 pipeline and the P2 pipeline can be executed simultaneously in parallel, and if the pipeline resources are insufficient, the pipelines are put into a queuing waiting queue in time sequence until the resources are released to meet the queued pipeline operation.
The operation monitoring module is used for acquiring the operation condition of each environment in real time, feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, and providing operation data support for the development assembly line and the operation and maintenance assembly line scheduling.
Wherein each environment includes a development environment, an integrated test environment, a quasi-production environment, and a production environment.
Optionally, the pipeline scheduling module is further configured to receive a code construction request sent by a user, determine whether the current remaining resources of each node meet the current pipeline resource quota, and if so, create a new service scheduling task.
The operation monitoring module collects resource information of each node from a current cluster at regular time, such as CPU, internal memory, disk and network occupation conditions, each pipeline is provided with resource quota configuration, after a user triggers the pipeline to start, the cluster detects each current node, if resources of a node meet the pipeline quota, pipeline changing operation is executed at the node, if no resource of the node in the cluster meets the pipeline resource quota, the pipeline enters a queuing waiting state until the node meets the condition, and the pipeline is executed.
Optionally, the work node module is further configured to receive the constructed code and generate one or more example copies of the code according to user configuration.
Optionally, the bottom-layer operating resource includes a computing resource pool, a storage resource pool, and a network resource pool.
Optionally, the work node module is a resource pool cluster.
The operation flow of the development, operation and maintenance integrated system provided by the embodiment of the invention is as follows:
a user logs in a development service module at a terminal, can edit codes with authority of the user on line after logging in, clicks and stores the codes after the codes are edited, and simultaneously can select whether to trigger code construction and a code release environment, if the code construction and the code release environment are selected, construction information is handed to a pipeline scheduling cluster;
after receiving a user construction request, the pipeline scheduling module checks the current system resource, and if the resource is enough, a pipeline scheduling task is newly established, wherein the task can be divided into the following stages: the method comprises a code construction and compiling stage, an engineering verification stage, an engineering release stage and an engineering deployment stage. Wherein:
the code building and compiling stage downloads code from a code repository, downloads dependency packages from a dependency repository, and then performs code compilation. Outputting an executable building package;
in the engineering verification stage, according to user configuration, multi-aspect tests such as unit test, integration test and the like are carried out on the executable building package;
in the engineering release stage, the tested construction package is set with version information and is released into a warehouse, and the construction package can be divided into a containerized mirror image package and a bare metal server operation package;
in the engineering deployment stage, the constructed application package is deployed to a working node cluster according to user configuration;
and after receiving the deployment request, the working node module generates one or more application example copies according to user configuration, so as to realize high-availability deployment of the application.
The development, operation and maintenance integrated system provided by the embodiment of the invention comprises a development service module, a pipeline scheduling module, a working node module and an operation monitoring module, wherein the development service module is used for code editing, code storage and code dependence management; the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition; the working node module is used for providing bottom layer operation resources for the pipeline scheduling module; the operation monitoring module is used for collecting the operation condition of each environment in real time and feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, so that the resource utilization rate, the product release efficiency and the system stability are improved, and a friendly development environment and good experience are provided for developers.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be appreciated that the relevant features of the method and apparatus described above are referred to one another.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In addition, the memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (7)

1. A development, operation and maintenance integrated system is characterized by comprising: development service module, assembly line scheduling module, work node module, operation monitoring module, wherein:
the development service module is used for code editing, code storage and code dependence management;
the assembly line scheduling module is used for modifying, editing and releasing the development assembly line and the operation and maintenance assembly line, organically connecting the whole development flow and the operation and maintenance flow together, managing all resources and dynamically distributing the running service to the server with lower load according to the load condition;
the working node module is used for providing bottom layer running resources for the pipeline scheduling module, wherein the bottom layer running resources are dynamically distributed according to the pipeline scheduling condition, and are uniformly recycled by the pipeline scheduling module after being distributed, so that the next scheduling is prepared;
the operation monitoring module is used for acquiring the operation condition of each environment in real time, feeding the operation condition of each environment back to development operation and maintenance personnel and the assembly line scheduling module, and providing operation data support for the development assembly line and the operation and maintenance assembly line scheduling.
2. The development, operation and maintenance integrated system according to claim 1, wherein the pipeline scheduling module is further configured to receive a code construction request sent by a user, determine whether current remaining resources of each node satisfy a current pipeline resource quota, and if so, create a new service scheduling task.
3. The development, operation and maintenance integration system of claim 1, wherein the working node module is further configured to receive the constructed code and generate one or more code example copies according to user configuration.
4. The development, operation and maintenance integrated system according to claim 1, wherein the bottom layer operating resources comprise a computing resource pool, a storage resource pool and a network resource pool.
5. The development, operation and maintenance integrated system according to claim 1, wherein the work node module is a resource pool cluster.
6. A computer program product, characterized in that the computer program product comprises a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to perform the method of claims 1-3.
7. A non-transitory computer-readable storage medium storing computer instructions that cause a computer to perform the method of claims 1-3.
CN202011243753.7A 2020-11-10 2020-11-10 Development, operation and maintenance integrated system Pending CN112328307A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011243753.7A CN112328307A (en) 2020-11-10 2020-11-10 Development, operation and maintenance integrated system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011243753.7A CN112328307A (en) 2020-11-10 2020-11-10 Development, operation and maintenance integrated system

Publications (1)

Publication Number Publication Date
CN112328307A true CN112328307A (en) 2021-02-05

Family

ID=74317201

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011243753.7A Pending CN112328307A (en) 2020-11-10 2020-11-10 Development, operation and maintenance integrated system

Country Status (1)

Country Link
CN (1) CN112328307A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113127368A (en) * 2021-04-30 2021-07-16 中原银行股份有限公司 Method, system and medium for generating assembly line
CN113641402A (en) * 2021-08-30 2021-11-12 北京读我科技有限公司 Method and device for realizing task arrangement and operation
CN114860406A (en) * 2022-05-18 2022-08-05 南京安元科技有限公司 Distributed compiling and packaging system and method based on Docker
CN116521363A (en) * 2023-04-06 2023-08-01 中保车服科技服务股份有限公司 Code packaging method, computer equipment and storage medium
CN116560658A (en) * 2023-06-29 2023-08-08 睿思芯科(深圳)技术有限公司 Cloud technology-based chip integrated development system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103095482A (en) * 2011-11-07 2013-05-08 上海宝信软件股份有限公司 Program development maintenance system
CN106708509A (en) * 2016-11-28 2017-05-24 上海宝尊电子商务有限公司 Automatic software project development all-link configuration management system
US20180300847A1 (en) * 2017-04-17 2018-10-18 Intel Corporation Adaptive compute size per workload
CN110069335A (en) * 2019-05-07 2019-07-30 江苏满运软件科技有限公司 Task processing system, method, computer equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103095482A (en) * 2011-11-07 2013-05-08 上海宝信软件股份有限公司 Program development maintenance system
CN106708509A (en) * 2016-11-28 2017-05-24 上海宝尊电子商务有限公司 Automatic software project development all-link configuration management system
US20180300847A1 (en) * 2017-04-17 2018-10-18 Intel Corporation Adaptive compute size per workload
CN110069335A (en) * 2019-05-07 2019-07-30 江苏满运软件科技有限公司 Task processing system, method, computer equipment and storage medium

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113127368A (en) * 2021-04-30 2021-07-16 中原银行股份有限公司 Method, system and medium for generating assembly line
CN113641402A (en) * 2021-08-30 2021-11-12 北京读我科技有限公司 Method and device for realizing task arrangement and operation
CN113641402B (en) * 2021-08-30 2024-07-12 北京读我科技有限公司 Task arrangement and operation realization method and device
CN114860406A (en) * 2022-05-18 2022-08-05 南京安元科技有限公司 Distributed compiling and packaging system and method based on Docker
CN114860406B (en) * 2022-05-18 2024-02-20 安元科技股份有限公司 Distributed compiling and packing system and method based on Docker
CN116521363A (en) * 2023-04-06 2023-08-01 中保车服科技服务股份有限公司 Code packaging method, computer equipment and storage medium
CN116521363B (en) * 2023-04-06 2024-01-30 中保车服科技服务股份有限公司 Code packaging method, computer equipment and storage medium
CN116560658A (en) * 2023-06-29 2023-08-08 睿思芯科(深圳)技术有限公司 Cloud technology-based chip integrated development system
CN116560658B (en) * 2023-06-29 2024-02-06 睿思芯科(深圳)技术有限公司 Cloud technology-based chip integrated development system

Similar Documents

Publication Publication Date Title
CN112328307A (en) Development, operation and maintenance integrated system
US10656929B2 (en) Autonomously healing microservice-based applications
US8893118B2 (en) Migratable unit based application migration
US9002997B2 (en) Instance host configuration
JP5897816B2 (en) Dependency graph parameter scoping
EP2948865B1 (en) Instance host configuration
US20070083588A1 (en) Systems and methods for automated provisioning of managed computing resources
US20170255886A1 (en) Workflow execution
US8966025B2 (en) Instance configuration on remote platforms
CN108984652A (en) A kind of configurable data cleaning system and method
US11947996B2 (en) Execution of services concurrently
CN112395196B (en) Data job development test method, device, equipment, system and storage medium
CN113609019A (en) Cross-cluster deployment pipeline method and device for container cloud application
CN107179982B (en) Cross-process debugging method and device
CN115632944B (en) Node configuration method, device, equipment, readable storage medium and server
US11108638B1 (en) Health monitoring of automatically deployed and managed network pipelines
CN110019144A (en) A kind of method and system of big data platform data O&M
CN114721824A (en) Resource allocation method, medium and electronic device
CN117435324B (en) Task scheduling method based on containerization
Fortier et al. Dyninka: a FaaS framework for distributed dataflow applications
CN116382694A (en) Method for improving compiling speed of Maven engineering in container environment
CN113515293B (en) Method and system for managing DevOps toolchain
US20210373868A1 (en) Automated Deployment And Management Of Network Intensive Applications
Goodwin et al. What goes wrong in serverless runtimes? A survey of bugs in Knative Serving
CN111367796A (en) Application program debugging method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination