CN113742029A - Docker-based DevOps continuous delivery system - Google Patents

Docker-based DevOps continuous delivery system Download PDF

Info

Publication number
CN113742029A
CN113742029A CN202010480716.1A CN202010480716A CN113742029A CN 113742029 A CN113742029 A CN 113742029A CN 202010480716 A CN202010480716 A CN 202010480716A CN 113742029 A CN113742029 A CN 113742029A
Authority
CN
China
Prior art keywords
data
analysis
retrieval
communication connection
docker
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010480716.1A
Other languages
Chinese (zh)
Inventor
刘建磊
解景阳
胡桂华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Hanxin Technology Co ltd
Original Assignee
Shandong Hanxin Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Hanxin Technology Co ltd filed Critical Shandong Hanxin Technology Co ltd
Priority to CN202010480716.1A priority Critical patent/CN113742029A/en
Publication of CN113742029A publication Critical patent/CN113742029A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45562Creating, deleting, cloning virtual machine instances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45591Monitoring or debugging support
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45595Network integration; Enabling network access in virtual machine instances

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a Docker-based DevOps continuous delivery system, which comprises a Docker engine, a data verification analysis system, a preposed data array storage system, a data storage system and an external access query system, wherein the Docker engine is used for generating a data verification analysis system; the Docker engine is in communication connection with an external data acquisition device in a network connection mode, and is used for creating a mirror image and a container.

Description

Docker-based DevOps continuous delivery system
Technical Field
The invention relates to the field of continuous delivery, in particular to a Docker-based DevOps continuous delivery system.
Background
Docker is an open source application container engine, so that developers can pack their applications and dependency packages into a portable image, and then distribute the image to any popular Linux or Windows machine, and also realize virtualization. The containers are fully sandboxed without any interface between each other.
For the continuous delivery system common at present, the whole safety protection system is very important.
Disclosure of Invention
The present invention aims to overcome the above-mentioned shortcomings and provide a technical solution to solve the above-mentioned problems.
A continuous delivery system of DevOps based on Docker comprises a Docker engine, a data verification analysis system, a preposed data array storage system, a data retention system and an external access query system;
the Docker engine is in communication connection with an external data acquisition device in a network connection mode, is used for creating a mirror image and a container, and eliminates redundant data, error data and discontinuous data in original external data by using the logic processing capacity of the Docker engine, so that the validity of the data is more reasonable;
the data verification analysis system is in communication connection with the Docker engine and is used for monitoring, analyzing and processing input data and output data of the Docker engine, and monitoring input reasonability and output reasonability of the data by using the data verification analysis system so as to avoid external abnormal data uploading or abnormal data downloading;
the preposed data array storage system is in communication connection with the data verification analysis system and is used for storing normal data output and processed by the data verification analysis system;
the prepositive data array storage system is in communication connection with a data persistence system, and the data persistence system is used for backing up data in the prepositive data array storage system in real time;
the external access inquiry system comprises an original data analysis and retrieval system, a backup data analysis and retrieval system, a data comparison system and a missing data temporary storage system;
the original data analysis and retrieval system is in communication connection with the preposed data array storage system and is used for analyzing and retrieving data in the preposed data array storage system;
the backup data analysis and retrieval system is in communication connection with the data storage system and is used for analyzing and retrieving data in the data storage system;
the data comparison system is respectively connected with the original data analysis and retrieval system and the backup data analysis and retrieval system, and the data comparison system obtains missing data by performing data comparison on the forms of the original data analysis and retrieval system and the backup data analysis and retrieval system;
the missing data temporary storage system is in communication connection with the data comparison system, and the missing data acquired by the data comparison system is stored by the missing data temporary storage system, so that the specific reasons of data missing can be conveniently researched in the later period, and the integrity and the safety of the data are protected.
As a further scheme of the invention: the original data analysis and retrieval system is also in communication connection with login equipment, the login equipment comprises a client, a network system and an identity verification system, and the network system is accessed to the Internet and realizes communication connection with the client; the network system is in communication connection with the identity verification system, wherein the identity verification system is used for verifying the access identity of the client, the client can access the original data analysis and retrieval system when the access identity is legal, and the original data analysis and retrieval system is used for realizing retrieval and access of data.
As a further scheme of the invention: the original data analysis and retrieval system, the backup data analysis and retrieval system and the missing data temporary storage system are all in communication connection with a control background.
As a further scheme of the invention: the control background comprises a background login system, a data analysis system and a monitoring alarm large screen, the background login system is used for accessing an original data analysis retrieval system, a backup data analysis retrieval system and a missing data temporary storage system, the data analysis system is used for acquiring the storage condition, the backup condition and the missing condition of data, and meanwhile, alarm information is transmitted to the monitoring alarm large screen according to preset setting to be displayed.
The invention has the beneficial effects that: the invention adopts the data backup and autonomous detection mode to detect the data effectiveness, realizes the sufficient data backup by using the data persistence system, simultaneously can monitor the loss condition of the data in real time by using the data comparison system, effectively ensures the integrity of the data to a certain extent integrally, and can quickly know the specific failure source by temporarily storing and analyzing the missing data, thereby further ensuring the operation stability of the system.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Detailed Description
In the embodiment of the invention, a Docker-based DevOps continuous delivery system comprises a Docker engine, a data verification analysis system, a preposed data array storage system, a data retention system and an external access query system;
the Docker engine is in communication connection with an external data acquisition device in a network connection mode, is used for creating a mirror image and a container, and eliminates redundant data, error data and discontinuous data in original external data by using the logic processing capacity of the Docker engine, so that the validity of the data is more reasonable;
the data verification analysis system is in communication connection with the Docker engine and is used for monitoring, analyzing and processing input data and output data of the Docker engine, and monitoring input reasonability and output reasonability of the data by using the data verification analysis system so as to avoid external abnormal data uploading or abnormal data downloading;
the preposed data array storage system is in communication connection with the data verification analysis system and is used for storing normal data output and processed by the data verification analysis system;
the prepositive data array storage system is in communication connection with a data persistence system, and the data persistence system is used for backing up data in the prepositive data array storage system in real time;
the external access inquiry system comprises an original data analysis and retrieval system, a backup data analysis and retrieval system, a data comparison system and a missing data temporary storage system;
the original data analysis and retrieval system is in communication connection with the preposed data array storage system and is used for analyzing and retrieving data in the preposed data array storage system;
the backup data analysis and retrieval system is in communication connection with the data storage system and is used for analyzing and retrieving data in the data storage system;
the data comparison system is respectively connected with the original data analysis and retrieval system and the backup data analysis and retrieval system, and the data comparison system obtains missing data by performing data comparison on the forms of the original data analysis and retrieval system and the backup data analysis and retrieval system;
the missing data temporary storage system is in communication connection with the data comparison system, and the missing data temporary storage system is used for storing the missing data acquired by the data comparison system, so that the specific reasons of data missing can be conveniently researched in the later period, and the integrity and the safety of the data are protected;
the original data analysis and retrieval system is also in communication connection with login equipment, the login equipment comprises a client, a network system and an identity verification system, and the network system is accessed to the Internet and realizes communication connection with the client; the network system is in communication connection with the identity verification system, wherein the identity verification system is used for verifying the access identity of the client, the client can access the original data analysis and retrieval system when the access identity is legal, and the original data analysis and retrieval system is used for realizing retrieval and access of data;
the original data analysis and retrieval system, the backup data analysis and retrieval system and the missing data temporary storage system are all in communication connection with a control background.
The control background comprises a background login system, a data analysis system and a monitoring alarm large screen, the background login system is used for accessing an original data analysis retrieval system, a backup data analysis retrieval system and a missing data temporary storage system, the data analysis system is used for acquiring the storage condition, the backup condition and the missing condition of data, and meanwhile, alarm information is transmitted to the monitoring alarm large screen according to preset setting to be displayed.
The working principle of the invention is as follows: this technical scheme adopts the data backup and the form of independently detecting to carry out the detection of data validity, utilizes the data persistence system to realize abundant data backup, and the data contrast system then can real time monitoring data's the condition of losing simultaneously, and the whole is effectual the integrality of having guaranteed data to a certain extent, and what the while can be very fast to the temporary storage and the analysis of disappearance data knows concrete fault source to further the operating stability of system has been guaranteed.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

Claims (4)

1. A continuous delivery system of DevOps based on Docker is characterized by comprising a Docker engine, a data verification analysis system, a preposed data array storage system, a data retention system and an external access query system;
the Docker engine is in communication connection with an external data acquisition device in a network connection mode, is used for creating a mirror image and a container, and eliminates redundant data, error data and discontinuous data in original external data by using the logic processing capacity of the Docker engine, so that the validity of the data is more reasonable;
the data verification analysis system is in communication connection with the Docker engine and is used for monitoring, analyzing and processing input data and output data of the Docker engine, and monitoring input reasonability and output reasonability of the data by using the data verification analysis system so as to avoid external abnormal data uploading or abnormal data downloading;
the preposed data array storage system is in communication connection with the data verification analysis system and is used for storing normal data output and processed by the data verification analysis system;
the prepositive data array storage system is in communication connection with a data persistence system, and the data persistence system is used for backing up data in the prepositive data array storage system in real time;
the external access inquiry system comprises an original data analysis and retrieval system, a backup data analysis and retrieval system, a data comparison system and a missing data temporary storage system;
the original data analysis and retrieval system is in communication connection with the preposed data array storage system and is used for analyzing and retrieving data in the preposed data array storage system;
the backup data analysis and retrieval system is in communication connection with the data storage system and is used for analyzing and retrieving data in the data storage system;
the data comparison system is respectively connected with the original data analysis and retrieval system and the backup data analysis and retrieval system, and the data comparison system obtains missing data by performing data comparison on the forms of the original data analysis and retrieval system and the backup data analysis and retrieval system;
the missing data temporary storage system is in communication connection with the data comparison system, and the missing data acquired by the data comparison system is stored by the missing data temporary storage system, so that the specific reasons of data missing can be conveniently researched in the later period, and the integrity and the safety of the data are protected.
2. The Docker-based DevOps continuous delivery system as claimed in claim 1, wherein the raw data analyzing and retrieving system is further communicatively connected with a login device, the login device comprises a client, a network system and an identity verification system, wherein the network system is connected to the Internet and realizes a communication connection with the client; the network system is in communication connection with the identity verification system, wherein the identity verification system is used for verifying the access identity of the client, the client can access the original data analysis and retrieval system when the access identity is legal, and the original data analysis and retrieval system is used for realizing retrieval and access of data.
3. The Docker-based DevOps continuous delivery system as claimed in claim 1, wherein the original data analysis and retrieval system, the backup data analysis and retrieval system and the missing data temporary storage system are all connected with a control background in communication.
4. The Docker-based DevOps continuous delivery system as claimed in claim 3, wherein the control background comprises a background login system, a data analysis system and a monitoring alarm large screen, the background login system is used to access the original data analysis and retrieval system, the backup data analysis and retrieval system and the missing data temporary storage system, the data analysis system is used to obtain the storage condition, the backup condition and the missing condition of the data, and simultaneously transmit the alarm information to the monitoring alarm large screen for display according to the predetermined setting.
CN202010480716.1A 2020-05-30 2020-05-30 Docker-based DevOps continuous delivery system Pending CN113742029A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010480716.1A CN113742029A (en) 2020-05-30 2020-05-30 Docker-based DevOps continuous delivery system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010480716.1A CN113742029A (en) 2020-05-30 2020-05-30 Docker-based DevOps continuous delivery system

Publications (1)

Publication Number Publication Date
CN113742029A true CN113742029A (en) 2021-12-03

Family

ID=78727785

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010480716.1A Pending CN113742029A (en) 2020-05-30 2020-05-30 Docker-based DevOps continuous delivery system

Country Status (1)

Country Link
CN (1) CN113742029A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116010241A (en) * 2022-11-17 2023-04-25 北京东方通科技股份有限公司 Extensible DevOps continuous delivery system and method thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106873975A (en) * 2016-12-30 2017-06-20 武汉默联股份有限公司 Devops based on Docker persistently pays and automated system and method
CN109213657A (en) * 2018-08-31 2019-01-15 东北电力大学 A kind of grid operation data cloud storage device
CN109669808A (en) * 2017-10-17 2019-04-23 中移(苏州)软件技术有限公司 A kind of method and apparatus of system backup

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106873975A (en) * 2016-12-30 2017-06-20 武汉默联股份有限公司 Devops based on Docker persistently pays and automated system and method
CN109669808A (en) * 2017-10-17 2019-04-23 中移(苏州)软件技术有限公司 A kind of method and apparatus of system backup
CN109213657A (en) * 2018-08-31 2019-01-15 东北电力大学 A kind of grid operation data cloud storage device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116010241A (en) * 2022-11-17 2023-04-25 北京东方通科技股份有限公司 Extensible DevOps continuous delivery system and method thereof
CN116010241B (en) * 2022-11-17 2023-09-22 北京东方通科技股份有限公司 Extensible DevOps continuous delivery system and method thereof

Similar Documents

Publication Publication Date Title
US10824725B2 (en) Automatic detection of software that performs unauthorized privilege escalation
CN104520869B (en) Credible performing environment virtual machine clone
CN104350466B (en) Virtual machine image writes lease
US20170248497A1 (en) Apparatus for Capturing Data Related to an Event Indicating Abnormal Function of a Machine
CN103812699A (en) Monitoring management system based on cloud computing
CN103577748A (en) Dynamic measuring method based on dependable computing and management system
US8205095B2 (en) Method and system for remotely debugging a failed computer machine
KR101725211B1 (en) Layered virtual machine integrity monitoring
US11522891B2 (en) Machine learning anomaly detection of process-loaded DLLs
US7027954B2 (en) Method and apparatus for retrieving activity data related to an activity
US9436539B2 (en) Synchronized debug information generation
CN103268277A (en) Method and system for outputting log information
CN105404581A (en) Database evaluation method and device
US20030120627A1 (en) Method and apparatus for retrieving time series data related to an activity
CN104618161A (en) Application cluster monitoring device and method
CN109213657B (en) Power grid operation data cloud storage device
CN104471584A (en) Network based management of protected data sets
CN113742029A (en) Docker-based DevOps continuous delivery system
WO2021034274A1 (en) Blockchain for operational data security in industrial control systems
CN105553743B (en) Obtain method, system, first network equipment and the third network equipment of log
CN113536304B (en) Anti-detour method and equipment based on operation and maintenance audit system
CN110532312A (en) A kind of industry interconnection cloud platform system based on big data
CN105404470B (en) Date storage method and safety device, data-storage system
JPH08508352A (en) Safe critical processor and processing method for data processing system
CN107770153B (en) General electric power information acquisition system based on collaborative safety protection model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination