CN112035091A - Agile delivery management method and system for shale gas field - Google Patents
Agile delivery management method and system for shale gas field Download PDFInfo
- Publication number
- CN112035091A CN112035091A CN202010693616.7A CN202010693616A CN112035091A CN 112035091 A CN112035091 A CN 112035091A CN 202010693616 A CN202010693616 A CN 202010693616A CN 112035091 A CN112035091 A CN 112035091A
- Authority
- CN
- China
- Prior art keywords
- service
- data
- module
- delivery
- agile
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012384 transportation and delivery Methods 0.000 title claims abstract description 135
- 238000007726 management method Methods 0.000 title claims abstract description 26
- 238000010276 construction Methods 0.000 claims abstract description 22
- 230000000007 visual effect Effects 0.000 claims abstract description 19
- 230000004044 response Effects 0.000 claims abstract description 9
- 238000013475 authorization Methods 0.000 claims description 30
- 238000013507 mapping Methods 0.000 claims description 24
- 238000012544 monitoring process Methods 0.000 claims description 14
- 238000000034 method Methods 0.000 claims description 11
- 238000007619 statistical method Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 9
- 239000000463 material Substances 0.000 claims description 7
- 238000012360 testing method Methods 0.000 claims description 5
- 238000012546 transfer Methods 0.000 claims description 5
- 238000013506 data mapping Methods 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 238000005536 corrosion prevention Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000013499 data model Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 2
- 230000037430 deletion Effects 0.000 claims description 2
- 238000011161 development Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/36—Software reuse
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/02—Agriculture; Fishing; Forestry; Mining
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Databases & Information Systems (AREA)
- Entrepreneurship & Innovation (AREA)
- General Health & Medical Sciences (AREA)
- General Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Computer Security & Cryptography (AREA)
- Educational Administration (AREA)
- Bioethics (AREA)
- Game Theory and Decision Science (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Computer Hardware Design (AREA)
- Life Sciences & Earth Sciences (AREA)
- Agronomy & Crop Science (AREA)
- Animal Husbandry (AREA)
- Marine Sciences & Fisheries (AREA)
- Mining & Mineral Resources (AREA)
- Primary Health Care (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides an agile delivery management method for a shale gas field, which defines assets of a database according to an object mode, and configures the objects to realize response to upper-layer application when providing service for upper-layer application requirements: configuring data required by upper-layer application for a single object in a visual clicking mode, and automatically generating a data interface; and for a plurality of objects, the related objects and attributes are associated by writing SQL statements, and the platform automatically analyzes and generates a data interface and hands over the data interface to upper-layer application. Through the two modes, technical personnel do not need to rewrite codes, the rapid configuration is realized, the use threshold of interface construction is greatly reduced, the configuration efficiency is improved, the consistency of the interfaces is ensured, and the agile delivery is realized in the true sense.
Description
Technical Field
The invention belongs to the field of shale gas field ground engineering construction, and further relates to an agile delivery management method and system for a shale gas field.
Background
The traditional data delivery is carried out according to specific service requirements and service stages, delivery objects are complex, delivery means are different, data delivery lacks global consciousness in planning, and delivery flows are not uniform and standard. A large amount of manpower needs to be concentrated in a short period to prepare for executing data handover, most information is not subjected to formal examination, an owner receives the information automatically, the integrity, the consistency and the correctness of the information are difficult to check in the handover process, and a large amount of time is needed for arranging the information in a later period.
When data delivery is carried out, customized development is carried out according to single and scattered interface requirements in a traditional mode, a series of software development processes such as code compiling, testing, publishing, deploying and commissioning need to be executed, the interface construction application threshold is high, the service is insufficient, the development period is long in implementation, the efficiency is low, the response speed is low, and unreasonable consumption in technology is caused.
The traditional data delivery mode lacks a standard work flow, the frequency, granularity, standard and technical means of data delivery are different, the delivery quality cannot be guaranteed, the delivery cost is high, and the service is insufficient.
In the service customization stage, after a service system puts forward an interface requirement, the conventional data delivery needs to be customized and developed every time, the steps of code compiling, testing, publishing, deploying, commissioning and the like are included, and the application threshold is high; the customized development time is long, the efficiency is low, the feedback speed is low, the links from development to operation are many, and problems can occur in each link to influence the timeliness of delivery; the service deployment may cause the system to stop or the system to be unavailable, which affects the continuity of the system. The non-standardized customization has low universality, makes the data non-uniform and lacks of fusion, and forms a data island.
Disclosure of Invention
The invention provides an agile delivery management method and a system thereof for a shale gas field aiming at the problems that each data delivery in the prior art needs customized development, has high application threshold and low efficiency, the assets of a database are defined according to an object mode, and when providing service for the requirement of upper application, the objects are configured to realize the response to the upper application: configuring data required by upper-layer application for a single object in a visual clicking mode, and automatically generating a data interface; for a plurality of objects, the correlation of related objects and attributes is carried out by compiling SQL sentences, the platform automatically analyzes and generates a data interface and hands over to upper-layer application, technical personnel do not need to compile codes again, rapid configuration is realized, the use threshold of interface construction is greatly reduced, the configuration efficiency is improved, the consistency of the interface is ensured, and the agile delivery in the true sense is realized.
The specific implementation content of the invention is as follows:
the invention provides an agile delivery management method for a shale gas field, which is characterized in that a data asset service of a shale gas field ground construction project is defined in a construction module, and a data asset structure is defined so as to construct a data asset structure definition table; before data is delivered to upper-layer application, the service customizing module customizes agile delivery service and sends the customized agile delivery service data to the delivery authorizing module; the customizing comprises the following steps: a wizard schema customization service is used for a single object and a script schema customization service is used for multiple objects.
To better implement the present invention, further said customizing service using a wizard schema for a single object is specifically operative to: firstly, defining basic service customization information of a guide mode; the basic service customization information of the guide mode comprises a service name, a service group, a request path, an interface protocol, a request mode and a data return type; and then selecting a corresponding data asset structure definition table, carrying out personalized configuration in a visual window through clicking, specifically requesting parameters and returning parameters for a single object, and finally storing the parameters as table data to finish customization.
To better implement the present invention, further said using a scripting mode customization service for a plurality of objects is specifically operative to: firstly, defining basic service customization information of a script mode, wherein the basic service customization information of the script mode comprises a service name, a service group, a request path, an interface protocol, a request mode and a data return type; then writing a query SQL statement; after writing, customizing request parameters and return parameters of a plurality of objects completely by inquiring SQL sentences, and finally saving the parameters as a delivery table to finish customization; or after the compiling is finished, personalized configuration is carried out on a compiling query SQL statement interface of the visual window in a clicking mode, request parameters and return parameters of a plurality of objects are compiled clearly, and finally the request parameters and the return parameters are stored as a delivery table to finish the customizing.
In order to better implement the present invention, further, the specific operations of defining the data asset service are: defining engineering entities for shale gas field ground engineering construction according to a service domain, and dividing the engineering entities into three-layer structures, wherein the three-layer structures comprise an engineering entity large class, an engineering entity small class and an engineering entity;
the engineering entity category is divided into the following categories according to different functional specialties in the shale gas field ground engineering construction project: the system comprises 14 primary structures including a project totality, a gathering and transportation station, a gathering and transportation pipeline, a station process pipeline, equipment and fittings, pipeline materials and components, power supply and distribution, water supply and drainage, fire fighting, building and structure, communication, instrument and automatic control, corrosion prevention and thermal engineering;
the engineering entity subclass is further divided according to specific services in the workflow under each function specialty on the basis of the engineering entity major class to obtain 74 secondary structures;
the engineering entity is divided according to equipment and materials which play different functions in the specific business process, and 146 three-level structures are obtained.
In order to better implement the present invention, further, the defined data asset service and the data asset structure are subjected to relationship binding in the building module, where the relationship binding specifically is: binding the data asset service and the data asset structure according to a one-to-one relationship, namely only one data asset structure service can be bound by one data asset service; after the relation binding is carried out, the data are sent to a mapping module, a source table, a source owner, a source system and a source field in the whole life cycle of the data and a corresponding target table, a target owner, a target system and a target field are defined in the mapping module, and then the generation link of the data is tracked through data mapping, so that the tracing is realized.
In order to better implement the invention, further, for the data from the source data system, the receiving module receives the data according to the mapping definition and sends the data to the service customizing module.
In order to better implement the invention, further, for the agile delivery service from the external data center, registration is performed in the service registration module, and after the upper application sends an access request to the platform, the access request of the upper application is converted to the external data center through the URL request path via the delivery module and the delivery authorization module.
In order to better realize the invention, the delivery authorization module carries out agile delivery service authorization on the upper layer application, and through authority distribution, the upper layer application can receive the table data corresponding to the customized service in the service customization module and the service registration module under the corresponding authority to realize the application of the data.
In order to better realize the invention, further, the operation and monitoring unit executes authorization and offline operation on the agile delivery service in operation, and checks the service details; the operation and monitoring unit executes operations of online, service editing and service deletion on the offline agile delivery service and performs service test; carrying out statistical analysis on the agile delivery service through the operation and monitoring unit, and displaying the statistical analysis result of the agile delivery service in a visual chart form; the content of the statistical analysis comprises service calling times, service access success rate, average response time, maximum response time, service access ranking and service quantity increment.
The invention also provides an agile delivery management system for the shale gas field, which is used for carrying out data transmission with an external data center, a source data system and an upper application and is used for agile delivery management, wherein the agile delivery management system comprises a data delivery unit and an operation and monitoring unit connected with the data delivery unit;
the data delivery unit comprises a construction module and a mapping module for constructing a data model, a service registration module, a receiving module, a service customizing module, a delivery authorization module and a handover module for sequentially transmitting data;
the construction module is used for defining data asset service and data asset structure, binding the defined data asset service and the defined data asset structure in a relation manner, and then sending the data asset service and the defined data asset structure to the mapping module for further processing;
the mapping module carries out mapping definition after receiving the relation binding definition of the building module, and sends the mapping definition to the receiving module for data analysis;
the receiving module carries out data transmission with the source data system, receives the table data of the source data system according to the mapping definition and sends the received table data to the service customizing module;
the service customizing module sends the table data of the customized agile delivery service to a delivery authorization module;
the service registration module is respectively connected with the external data center station and the delivery authorization module, receives service registration of the external data center station, converts an access request of an upper application to the external data center station through a URL request path via the handover module and the delivery authorization module after the upper application sends the access request to the platform, receives table data of an agile delivery service from the external data center station and sends the table data to the delivery authorization module, and simultaneously, the handover module performs data transmission with the upper application, receives the access request of the upper application to the external data center station and transfers the access request to an upper system;
the delivery authorization module receives table data of the agile delivery service from the service customization module and the service registration module, and sends the table data to the upper application after permission distribution;
the operation and monitoring unit comprises a customized visual window used for displaying the statistic analysis result of the agile delivery service and carrying out the agile delivery service through visual operation.
Compared with the prior art, the invention has the following advantages and beneficial effects:
(1) technical personnel do not need to rewrite codes, rapid configuration is realized, the use threshold of interface construction is greatly reduced, the configuration efficiency is improved, the consistency of the interfaces is ensured, and agile delivery in the true sense is realized;
(2) the invention solidifies a set of standardized flow of data delivery on a full digitalization transfer management platform: starting from the data asset service definition, sequentially carrying out links such as data asset structure definition, data asset association definition, data mapping definition, customized agile delivery data service, agile delivery service registration, agile delivery service authorization, agile delivery service operation and monitoring and the like, realizing standardization, flow and service of the whole process from data access to data output, and effectively fusing the application of the data;
(3) the problem that the traditional delivery mode cannot quantitatively and systematically analyze the data delivery service quality is solved, the innovative delivery mode enables the platform to automatically carry out agile delivery statistical analysis, and the result is displayed in a visual chart mode, so that users can visually know the scale and quality of the platform data assets, customize service, find service problems, optimize service flow and the like.
Drawings
FIG. 1 is a flow chart of the internal system data asset business agile delivery of the present invention;
FIG. 2 is a diagram of a customized virtual operations interface for a visualization service for a single object;
FIG. 3 is a diagram of customizing an actual operational interface for an SQL statement writing service for a plurality of objects;
FIG. 4 is a flowchart of the overall agility delivery of the present invention;
FIG. 5 is a schematic diagram showing the connection of the unit modules of the system of the present invention.
Detailed Description
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments, and therefore should not be considered as a limitation to the scope of protection. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
In the description of the present invention, it is to be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Example 1:
the invention provides an agile delivery management method for a shale gas field, which comprises the following steps of:
firstly, defining agile delivery data asset service: defining engineering entities for shale gas field ground engineering construction according to service domains, and dividing three layers of service structures, wherein the three layers of service structures comprise an engineering entity large class, an engineering entity small class and an engineering entity; the engineering entity division is based on national, industrial and enterprise standards, takes the unconventional specificity of the shale gas field into consideration, carries out corresponding adjustment, forms a shale gas field engineering data asset catalogue, and is specifically classified as follows:
(1) the engineering entity is divided into 14 primary structures including project totality, gathering and transportation stations, gathering and transportation pipelines, station process pipelines, equipment and accessories, pipeline materials and components, power supply and distribution, water supply and drainage, fire protection, buildings and structures, communication, instruments and automatic control, corrosion prevention and thermal engineering according to different functions in ground engineering construction projects;
(2) the engineering entity subclass is further divided according to the specific services in the workflow under each specialty and according to different functions to obtain 74 secondary structures; taking a gathering and transportation pipeline as an example, the gathering and transportation pipeline comprises 3 secondary structures of pipeline foundation information, pipeline construction and line auxiliary structures;
(3) the engineering entity is divided according to equipment and materials which play different functions in the specific business process, and 146 three-level structures are obtained in total; taking gathering and transportation pipeline-pipeline basic information as an example, the gathering and transportation pipeline-pipeline basic information comprises 5 three-stage structures of pipelines, pipe sections, traversing, crossing and mountain tunnels.
And step two, defining an agile delivery data asset structure, wherein the specific local standard for defining the agile delivery data asset structure is as follows:
(1) defining English names and Chinese names of the data asset structure table, and filling field names and attributes thereof;
(2) the name definition of the data asset structure table refers to a unified full-digital transfer management platform data standard, names are sequentially given from a high-level structure to a low-level structure according to the service structure in the step one, all levels are connected by using a _ \;
(3) the field names and their attribute definitions in the data asset structure table refer to "oil industry materials classification and code (2012 edition)", which requires field accuracy and generality.
And step three, carrying out relation binding on the agile delivery data asset service and the agile delivery data asset structure defined in the step one, wherein the relation binding is carried out according to one-to-one relation binding, namely one data asset service definition can only bind one data asset structure definition.
Step four, data mapping is carried out: tracking a data generation link, and defining the corresponding relation between a source table, a source owner, a source system, a source field and a target table, a target owner, a target system and a target field in the whole life cycle of data so as to meet the data tracing requirement and control the quality of data assets.
Step five, carrying out agile delivery service customization: developers do not need to rewrite codes every time, and a guide mode and a script mode are directly used for visually and quickly customizing data services; the customization comprises the steps of using a guide mode customization service for a single object and using a script mode customization service for a plurality of objects, and the specific operations are as follows:
(1) for a single object, the service is customized by using a guide mode, in a visual window, only simple clicking is needed, corresponding parameters can be configured for the object to form a table structure, a system automatically creates a data interface for handing over the service to an upper-layer application according to rules, and has no technical threshold, the screenshot of the interface during actual operation and application is shown in fig. 2, and the specific steps are as follows:
defining basic service customization information: the method comprises the steps of service name, service grouping, request path, interface protocol, request mode and data return type;
selecting a corresponding asset structure definition table, performing personalized configuration in a visual window through clicking, defining a request parameter and a return parameter, and finishing service customization after storing;
(2) the script mode customizing service is used for a plurality of objects, and the defect that the plurality of objects cannot be combined into one interface in the guide mode is overcome; the SQL statement can be written, a plurality of parameters of a plurality of objects are connected to form a delivery table, the system automatically reads the SQL statement, an interface for handing over a plurality of data to upper-layer application is created, the requirement of higher freedom degree is met, the rewriting of bottom-layer codes is not needed, the screenshot of the actual operation interface is shown in figure 3, and the specific steps are as follows:
defining basic service customization information: the method comprises the steps of service name, service grouping, request path, interface protocol, request mode and data return type;
writing and inquiring SQL sentences, customizing the attributes of the request parameters and the return parameters through the pure SQL sentences, clicking personalized configuration on an interface of writing and inquiring SQL sentences to help to write the request parameters and the return parameters in the SQL sentences through a click mode, and finishing service customization after storage.
Step six: and (4) authorizing agile delivery service to realize data application, wherein the upper layer application can receive data only after authorization. And after the permission distribution, the upper layer application can receive the table data corresponding to the customized service in the step five under the corresponding permission, so that the application of the data is realized.
Example 2:
based on the above embodiment 1, to better implement the present invention, as shown in fig. 4, further, based on the actual situation of the external data middlebox/data warehouse already stored inside the enterprise and the requirement of the enterprise to establish a unified data source to provide data services to the upper layer application, the data from the external data middlebox also needs to be transferred to the upper layer application through the unified data outlet of the delivery authorization module. The data service of the external data center station is registered in the service registration module, and after the upper layer application sends a request, the data of the external data center station is switched and accessed through the URL request path through the handover module and the delivery authorization module.
Other parts of this embodiment are the same as those of embodiment 1, and thus are not described again.
Example 3:
on the basis of any one of the above embodiments 1-2, as shown in fig. 4, the present invention further provides agile delivery service operation and monitoring, which includes the following specific contents:
(1) authorization and offline operations can be performed on the agile delivery service in operation, and service details can be checked; the on-line and service editing/deleting operations can be executed for the off-line agile delivery service, and the service test can be carried out;
(2) displaying an agile delivery statistical analysis result in a visual chart mode, wherein the statistical analysis result comprises service calling times, service access success rate, average response time, maximum response time, service access ranking and service quantity increment statistics; through the statistical analysis of agile delivery, the model, file and data scale currently stored by the platform can be basically known; the quality of data assets is mastered through the receiving success rate and the service access success rate of the model, the data and the file, and the customized service is improved; counting and identifying the demand condition and change in the service according to the service calling times, the service access ranking and the service quantity increment, and being beneficial to discovering and solving the service problem in time; the agile delivery statistical analysis result is displayed in a visual chart mode, so that users can know the information intuitively, and the management decision-making personnel are energized.
Other parts of this embodiment are the same as any of embodiments 1-2 described above, and thus are not described again.
Example 4:
the invention also provides an agile delivery management system for the shale gas field, which is used for carrying out data transmission with an external data center, a source data system and an upper application for agile delivery management, and comprises a data delivery unit and an operation and monitoring unit connected with the data delivery unit, as shown in fig. 5;
the data delivery unit comprises a construction module and a mapping module for constructing a data model, a service registration module, a receiving module, a service customizing module, a delivery authorization module and a handover module for sequentially transmitting data;
the construction module is used for defining data asset service and data asset structure, binding the defined data asset service and the defined data asset structure in a relation manner, and then sending the data asset service and the defined data asset structure to the mapping module for further processing;
the mapping module carries out mapping definition after receiving the relation binding definition of the building module, and sends the mapping definition to the receiving module for data analysis;
the receiving module carries out data transmission with the source data system, receives the table data of the source data system according to the mapping definition and sends the received table data to the service customizing module;
the service customizing module sends the table data of the customized agile delivery service to a delivery authorization module;
the service registration module is respectively connected with the external data center station and the delivery authorization module, receives service registration of the external data center station, converts an access request of an upper application to the external data center station through a URL request path via the handover module and the delivery authorization module after the upper application sends the access request to the platform, receives table data of an agile delivery service from the external data center station and sends the table data to the delivery authorization module, and simultaneously, the handover module performs data transmission with the upper application, receives the access request of the upper application to the external data center station and transfers the access request to an upper system;
the delivery authorization module receives table data of the agile delivery service from the service customization module and the service registration module, and sends the table data to the upper application after permission distribution;
the operation and monitoring unit comprises a customized visual window used for displaying the statistic analysis result of the agile delivery service and carrying out the agile delivery service through visual operation.
Other parts of this embodiment are the same as any of embodiments 1 to 3, and thus are not described again.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way, and all simple modifications and equivalent variations of the above embodiments according to the technical spirit of the present invention are included in the scope of the present invention.
Claims (10)
1. An agile delivery management method for a shale gas field is characterized in that a data asset service of a shale gas field ground construction project is defined in a construction module, and a data asset structure is defined so as to construct a data asset structure definition table; before data is delivered to upper-layer application, the service customizing module customizes agile delivery service and sends the customized agile delivery service data to the delivery authorizing module; the customizing comprises the following steps: a wizard schema customization service is used for a single object and a script schema customization service is used for multiple objects.
2. The agile delivery management method for shale gas fields according to claim 1, wherein said using a wizard mode customization service for single object specific operations are: firstly, defining basic service customization information of a guide mode; the basic service customization information of the guide mode comprises a service name, a service group, a request path, an interface protocol, a request mode and a data return type; and then selecting a corresponding data asset structure definition table, carrying out personalized configuration in a visual window through clicking, specifically requesting parameters and returning parameters for a single object, and finally storing the parameters as table data to finish customization.
3. The agile delivery management method for a shale gas field according to claim 1, wherein said using a scripting mode customization service for a plurality of objects is specifically operative to: firstly, defining basic service customization information of a script mode, wherein the basic service customization information of the script mode comprises a service name, a service group, a request path, an interface protocol, a request mode and a data return type; then writing a query SQL statement; after writing, customizing request parameters and return parameters of a plurality of objects completely by inquiring SQL sentences, and finally saving the parameters as a delivery table to finish customization; or after the compiling is finished, personalized configuration is carried out on a compiling query SQL statement interface of the visual window in a clicking mode, request parameters and return parameters of a plurality of objects are compiled clearly, and finally the request parameters and the return parameters are stored as a delivery table to finish the customizing.
4. The agile delivery management method for shale gas fields according to claim 1, wherein the concrete operations of defining data asset business are: defining engineering entities for shale gas field ground engineering construction according to a service domain, and dividing the engineering entities into three-layer structures, wherein the three-layer structures comprise an engineering entity large class, an engineering entity small class and an engineering entity;
the engineering entity category is divided into the following categories according to different functional specialties in the shale gas field ground engineering construction project: the system comprises 14 primary structures including a project totality, a gathering and transportation station, a gathering and transportation pipeline, a station process pipeline, equipment and fittings, pipeline materials and components, power supply and distribution, water supply and drainage, fire fighting, building and structure, communication, instrument and automatic control, corrosion prevention and thermal engineering;
the engineering entity subclass is further divided according to specific services in the workflow under each function specialty on the basis of the engineering entity major class to obtain 74 secondary structures;
the engineering entity is divided according to equipment and materials which play different functions in the specific business process, and 146 three-level structures are obtained.
5. The agile delivery management method for shale gas fields according to claim 4, wherein the defined data asset business is related bound to a data asset structure in a build module, the relationship binding being specifically: binding the data asset service and the data asset structure according to a one-to-one relationship, namely only one data asset structure service can be bound by one data asset service; after the relation binding is carried out, the data are sent to a mapping module, a source table, a source owner, a source system and a source field in the whole life cycle of the data and a corresponding target table, a target owner, a target system and a target field are defined in the mapping module, and then the generation link of the data is tracked through data mapping, so that the tracing is realized.
6. The agile delivery management method for shale gas fields according to claim 1 wherein for data from the source data system, the receiving module receives data according to the mapping definition and sends the data to the service customization module.
7. The agile delivery management method for shale gas fields as claimed in claim 1, wherein for agile delivery service from external data middleboxes, registration is performed in a service registration module, and after an upper application sends an access request to the platform, the access request of the upper application is converted to the external data middleboxes through a URL request path via a handover module and a delivery authorization module.
8. The agile delivery management method for the shale gas field according to claim 6 or 7, wherein the delivery authorization module authorizes the agile delivery service to the upper application, and the upper application can receive the table data corresponding to the service customized in the service customization module and the service registration module under the corresponding authority through the authority distribution to realize the data application.
9. The agile delivery management method for shale gas fields according to claim 8, wherein authorization and offline operations are performed on the agile delivery service in operation through the operation and monitoring unit, and service details are checked; the operation and monitoring unit executes operations of online, service editing and service deletion on the offline agile delivery service and performs service test; carrying out statistical analysis on the agile delivery service through the operation and monitoring unit, and displaying the statistical analysis result of the agile delivery service in a visual chart form; the content of the statistical analysis comprises service calling times, service access success rate, average response time, maximum response time, service access ranking and service quantity increment.
10. An agile delivery management system for a shale gas field is used for carrying out data transmission with an external data center, a source data system and an upper application and is used for agile delivery management, and is characterized by comprising a data delivery unit and an operation and monitoring unit connected with the data delivery unit;
the data delivery unit comprises a construction module and a mapping module for constructing a data model, a service registration module, a receiving module, a service customizing module, a delivery authorization module and a handover module for sequentially transmitting data;
the construction module is used for defining data asset service and data asset structure, binding the defined data asset service and the defined data asset structure in a relation manner, and then sending the data asset service and the defined data asset structure to the mapping module for further processing;
the mapping module carries out mapping definition after receiving the relation binding definition of the building module, and sends the mapping definition to the receiving module for data analysis;
the receiving module carries out data transmission with the source data system, receives the table data of the source data system according to the mapping definition and sends the received table data to the service customizing module;
the service customizing module sends the table data of the customized agile delivery service to a delivery authorization module;
the service registration module is respectively connected with the external data center station and the delivery authorization module, receives service registration of the external data center station, converts an access request of an upper application to the external data center station through a URL request path via the handover module and the delivery authorization module after the upper application sends the access request to the platform, receives table data of an agile delivery service from the external data center station and sends the table data to the delivery authorization module, and simultaneously, the handover module performs data transmission with the upper application, receives the access request of the upper application to the external data center station and transfers the access request to an upper system;
the delivery authorization module receives table data of the agile delivery service from the service customization module and the service registration module, and sends the table data to the upper application after permission distribution;
the operation and monitoring unit comprises a customized visual window used for displaying the statistic analysis result of the agile delivery service and carrying out the agile delivery service through visual operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010693616.7A CN112035091B (en) | 2020-07-17 | 2020-07-17 | Agile delivery management method and system for shale gas field |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010693616.7A CN112035091B (en) | 2020-07-17 | 2020-07-17 | Agile delivery management method and system for shale gas field |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112035091A true CN112035091A (en) | 2020-12-04 |
| CN112035091B CN112035091B (en) | 2023-07-28 |
Family
ID=73579299
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010693616.7A Active CN112035091B (en) | 2020-07-17 | 2020-07-17 | Agile delivery management method and system for shale gas field |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112035091B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104144210A (en) * | 2014-07-09 | 2014-11-12 | 中电科华云信息技术有限公司 | Method and system for automatically building data service |
| CN106095894A (en) * | 2016-06-07 | 2016-11-09 | 浪潮软件股份有限公司 | A kind of self-defining data service implementing method being applicable to tobacco business |
| CN107679071A (en) * | 2017-08-22 | 2018-02-09 | 中国科学院计算机网络信息中心 | A kind of generic data service of facing relation database customizes method for packing |
| CN109165914A (en) * | 2018-07-30 | 2019-01-08 | 中国石油化工股份有限公司 | The process dissemination method for exempting from program parameters configuration for mobile examination & approval |
| CN109542506A (en) * | 2018-12-06 | 2019-03-29 | 广州万惠信息技术咨询服务有限公司 | A kind of system of flexibly configurable interface and quick delivery service |
| US20190121623A1 (en) * | 2017-10-23 | 2019-04-25 | Open Text Sa Ulc | Universal application framework for streamlined frontend development of user interface applications |
| CN110807015A (en) * | 2019-09-25 | 2020-02-18 | 上海悦程信息技术有限公司 | Big data asset value delivery management method and system |
-
2020
- 2020-07-17 CN CN202010693616.7A patent/CN112035091B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104144210A (en) * | 2014-07-09 | 2014-11-12 | 中电科华云信息技术有限公司 | Method and system for automatically building data service |
| CN106095894A (en) * | 2016-06-07 | 2016-11-09 | 浪潮软件股份有限公司 | A kind of self-defining data service implementing method being applicable to tobacco business |
| CN107679071A (en) * | 2017-08-22 | 2018-02-09 | 中国科学院计算机网络信息中心 | A kind of generic data service of facing relation database customizes method for packing |
| US20190121623A1 (en) * | 2017-10-23 | 2019-04-25 | Open Text Sa Ulc | Universal application framework for streamlined frontend development of user interface applications |
| CN109165914A (en) * | 2018-07-30 | 2019-01-08 | 中国石油化工股份有限公司 | The process dissemination method for exempting from program parameters configuration for mobile examination & approval |
| CN109542506A (en) * | 2018-12-06 | 2019-03-29 | 广州万惠信息技术咨询服务有限公司 | A kind of system of flexibly configurable interface and quick delivery service |
| CN110807015A (en) * | 2019-09-25 | 2020-02-18 | 上海悦程信息技术有限公司 | Big data asset value delivery management method and system |
Non-Patent Citations (2)
| Title |
|---|
| 宋琦: "基于数据服务的数据集成开发工具的优化与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》, pages 138 - 240 * |
| 郑宇 等: "制造领域科学数据共享服务定制的研究与应用", 《计算机工程》, vol. 37, pages 33 - 35 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112035091B (en) | 2023-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105022769B (en) | A kind of City Underground Pipeline interactive system and its method | |
| Jin et al. | The virtual design team: A computational model of project organizations | |
| US8473263B2 (en) | Multi-infrastructure modeling and simulation system | |
| Zhu et al. | A framework-based approach to utility big data analytics | |
| CN108971807A (en) | A kind of site welding construction technology intelligent management control method and management system | |
| CN113706110B (en) | FPGA test tool integrated test management platform | |
| CN106982251B (en) | It is mobile device-based to reconnoitre project field work data reporting method and system | |
| Figueiredo et al. | Water wise–a digital water solution for smart cities and water management entities | |
| US20050267771A1 (en) | Apparatus, system and method for integrated lifecycle management of a facility | |
| CN113204329A (en) | Control method for driving business application by unified data model and application system thereof | |
| CN112050092A (en) | Water supply pipe network leakage information management system, building method and application | |
| Wang et al. | Adopting BIM to facilitate dispute management in the construction industry: A conceptual framework development | |
| CN114816591A (en) | Service interface processing method and device, computer equipment and storage medium | |
| Zheng et al. | A shared ontology for logistics information management in the construction industry | |
| CN114066217A (en) | Method, system and equipment for constructing business-oriented enterprise IT operation and service system | |
| CN112035091B (en) | Agile delivery management method and system for shale gas field | |
| Eirinaki et al. | A cloud-based framework for smart permit system for buildings | |
| Jing et al. | Development of BIM-Sensor integrated platform for MEP piping maintenance | |
| CN113342987A (en) | Composite network construction method of special corpus for power distribution DTU acceptance | |
| TW200939140A (en) | System and method for maintaining and managing facility and equipment using radio frequency identification | |
| Hughes et al. | Developing an integrated energy and communications systems architecture: the initial steps | |
| Wang et al. | Augmented Reality adoption in the Australian construction industry: A qualitative framework | |
| Wu et al. | Integration and formal representation in civil engineering supervision based on data-driven | |
| CN115587692A (en) | Building construction technical scheme management system and method based on informatization management platform | |
| SHIN | A Proposal on the Development Methodology and Data Governance for the Implement and Operation of Big Data System in Water Resources (based on K-water case) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |